2026-02-13T08:01:31.906 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-13T08:01:31.925 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T08:01:32.006 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874 branch: wip-bharath17-testing-2026-02-12-0618-tentacle description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{avl} base mem$/{normal-2} onode-segment$/{512K} write$/{v2/{compr$/{yes$/{lz4}} v2}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_api_tests} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '47874' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath17-testing-2026-02-12-0618-tentacle ceph: conf: client: debug monc: 20 debug ms: 1 global: debug ms: 1 debug objecter: 20 debug rados: 20 mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 mon warn on pool no app: false paxos min: 10 paxos service trim min: 5 paxos trim min: 10 osd: bdev async discard: true bdev enable discard: true bluestore allocator: avl bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true bluestore onode segment size: 512K bluestore write v2: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd class default list: '*' osd class load list: '*' osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random osd_mclock_skip_benchmark: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) - reached quota - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_FULL\) - \(SLOW_OPS\) - \(MON_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - slow request mon_bind_msgr2: false sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath17-testing-2026-02-12-0618-tentacle sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 80 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - osd.0 - osd.1 - osd.2 - - mon.b - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 2723 sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath17-testing-2026-02-12-0618-tentacle suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb targets: trial104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNeaKPCwCyoPwnH4h4T+NzxDi3zM0w/p1SVX4uebXDJ/uns43ik/HKWQ4cVw0GXpZD2/PGPi2OYP3DKBTE+Hf0= trial119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBlWFH1RywrjD6t12EIGVnjZb0oehWKmnmaloznZaiqPeOQFp16CAZnZXVZy2xOisWRUYQH/yM2XULW3GtGVv80= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 thrash_delay: 1 thrash_many: true - workunit: clients: client.0: - rados/test.sh unit_test_scan teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-13_01:43:11 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T08:01:32.006 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa; will attempt to use it 2026-02-13T08:01:32.006 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa/tasks 2026-02-13T08:01:32.006 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T08:01:32.008 INFO:teuthology.task.internal:Checking packages... 2026-02-13T08:01:32.008 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb' 2026-02-13T08:01:32.008 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T08:01:32.008 INFO:teuthology.packaging:ref: None 2026-02-13T08:01:32.008 INFO:teuthology.packaging:tag: None 2026-02-13T08:01:32.008 INFO:teuthology.packaging:branch: wip-bharath17-testing-2026-02-12-0618-tentacle 2026-02-13T08:01:32.008 INFO:teuthology.packaging:sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T08:01:32.008 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath17-testing-2026-02-12-0618-tentacle 2026-02-13T08:01:32.134 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-636-g3b40640f-1jammy 2026-02-13T08:01:32.135 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T08:01:32.146 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T08:01:32.147 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T08:01:32.166 INFO:teuthology.task.internal:Saving configuration 2026-02-13T08:01:32.177 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T08:01:32.189 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T08:01:32.267 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial104.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 07:58:10.287650', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE5i6tVk6QKwgRYmJykhaVoTa+UZP3YbcpSdICh9VN8e'} 2026-02-13T08:01:32.324 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial119.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 07:58:10.288225', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFSEy7UNX4feGpmFDV4OFNYwUTWWhk0cWKfywquXp9dD'} 2026-02-13T08:01:32.324 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T08:01:32.335 INFO:teuthology.task.internal:roles: ubuntu@trial104.front.sepia.ceph.com - ['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'] 2026-02-13T08:01:32.335 INFO:teuthology.task.internal:roles: ubuntu@trial119.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2026-02-13T08:01:32.335 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T08:01:32.471 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x76b10f7bed40>, signals=[15]) 2026-02-13T08:01:32.471 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T08:01:32.482 INFO:teuthology.task.internal:Opening connections... 2026-02-13T08:01:32.482 DEBUG:teuthology.task.internal:connecting to ubuntu@trial104.front.sepia.ceph.com 2026-02-13T08:01:32.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T08:01:32.545 DEBUG:teuthology.task.internal:connecting to ubuntu@trial119.front.sepia.ceph.com 2026-02-13T08:01:32.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T08:01:32.606 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T08:01:32.618 DEBUG:teuthology.orchestra.run.trial104:> uname -m 2026-02-13T08:01:32.622 INFO:teuthology.orchestra.run.trial104.stdout:x86_64 2026-02-13T08:01:32.622 DEBUG:teuthology.orchestra.run.trial104:> cat /etc/os-release 2026-02-13T08:01:32.667 INFO:teuthology.orchestra.run.trial104.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-13T08:01:32.667 INFO:teuthology.orchestra.run.trial104.stdout:NAME="Ubuntu" 2026-02-13T08:01:32.667 INFO:teuthology.orchestra.run.trial104.stdout:VERSION_ID="22.04" 2026-02-13T08:01:32.668 INFO:teuthology.orchestra.run.trial104.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-13T08:01:32.668 INFO:teuthology.orchestra.run.trial104.stdout:VERSION_CODENAME=jammy 2026-02-13T08:01:32.668 INFO:teuthology.orchestra.run.trial104.stdout:ID=ubuntu 2026-02-13T08:01:32.668 INFO:teuthology.orchestra.run.trial104.stdout:ID_LIKE=debian 2026-02-13T08:01:32.668 INFO:teuthology.orchestra.run.trial104.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-13T08:01:32.668 INFO:teuthology.orchestra.run.trial104.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-13T08:01:32.668 INFO:teuthology.orchestra.run.trial104.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-13T08:01:32.668 INFO:teuthology.orchestra.run.trial104.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-13T08:01:32.668 INFO:teuthology.orchestra.run.trial104.stdout:UBUNTU_CODENAME=jammy 2026-02-13T08:01:32.668 INFO:teuthology.lock.ops:Updating trial104.front.sepia.ceph.com on lock server 2026-02-13T08:01:32.736 DEBUG:teuthology.orchestra.run.trial119:> uname -m 2026-02-13T08:01:32.740 INFO:teuthology.orchestra.run.trial119.stdout:x86_64 2026-02-13T08:01:32.740 DEBUG:teuthology.orchestra.run.trial119:> cat /etc/os-release 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:NAME="Ubuntu" 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:VERSION_ID="22.04" 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:VERSION_CODENAME=jammy 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:ID=ubuntu 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:ID_LIKE=debian 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-13T08:01:32.784 INFO:teuthology.orchestra.run.trial119.stdout:UBUNTU_CODENAME=jammy 2026-02-13T08:01:32.784 INFO:teuthology.lock.ops:Updating trial119.front.sepia.ceph.com on lock server 2026-02-13T08:01:32.855 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T08:01:32.867 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T08:01:32.880 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T08:01:32.880 DEBUG:teuthology.orchestra.run.trial104:> test '!' -e /home/ubuntu/cephtest 2026-02-13T08:01:32.881 DEBUG:teuthology.orchestra.run.trial119:> test '!' -e /home/ubuntu/cephtest 2026-02-13T08:01:32.884 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T08:01:32.895 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T08:01:32.895 DEBUG:teuthology.orchestra.run.trial104:> test -z $(ls -A /var/lib/ceph) 2026-02-13T08:01:32.925 DEBUG:teuthology.orchestra.run.trial119:> test -z $(ls -A /var/lib/ceph) 2026-02-13T08:01:32.928 INFO:teuthology.orchestra.run.trial104.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-13T08:01:32.932 INFO:teuthology.orchestra.run.trial119.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-13T08:01:32.933 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T08:01:33.079 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T08:01:33.098 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-13T08:01:33.098 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-13T08:01:33.098 DEBUG:teuthology.orchestra.run.trial104:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T08:01:33.098 DEBUG:teuthology.orchestra.run.trial119:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T08:01:33.101 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T08:01:33.102 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-13T08:01:33.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T08:01:33.102 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-13T08:01:33.147 INFO:teuthology.orchestra.run.trial104.stdout:5.15.0-164-generic 2026-02-13T08:01:33.147 INFO:teuthology.task.kernel:Running kernel on trial104: 5.15.0-164-generic 2026-02-13T08:01:33.147 DEBUG:teuthology.orchestra.run.trial104:> sudo apt-get clean 2026-02-13T08:01:33.152 INFO:teuthology.orchestra.run.trial119.stdout:5.15.0-164-generic 2026-02-13T08:01:33.152 INFO:teuthology.task.kernel:Running kernel on trial119: 5.15.0-164-generic 2026-02-13T08:01:33.152 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get clean 2026-02-13T08:01:33.205 DEBUG:teuthology.orchestra.run.trial104:> sudo apt-get update 2026-02-13T08:01:33.211 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get update 2026-02-13T08:01:33.716 INFO:teuthology.orchestra.run.trial104.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T08:01:33.717 INFO:teuthology.orchestra.run.trial119.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T08:01:33.789 INFO:teuthology.orchestra.run.trial104.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-13T08:01:33.789 INFO:teuthology.orchestra.run.trial119.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-13T08:01:34.065 INFO:teuthology.orchestra.run.trial104.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-13T08:01:34.066 INFO:teuthology.orchestra.run.trial119.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-13T08:01:34.187 INFO:teuthology.orchestra.run.trial104.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-13T08:01:34.188 INFO:teuthology.orchestra.run.trial119.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-13T08:01:34.301 INFO:teuthology.orchestra.run.trial104.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3226 kB] 2026-02-13T08:01:34.303 INFO:teuthology.orchestra.run.trial119.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3226 kB] 2026-02-13T08:01:34.629 INFO:teuthology.orchestra.run.trial104.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [492 kB] 2026-02-13T08:01:34.632 INFO:teuthology.orchestra.run.trial119.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [492 kB] 2026-02-13T08:01:34.638 INFO:teuthology.orchestra.run.trial104.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-13T08:01:34.638 INFO:teuthology.orchestra.run.trial104.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1254 kB] 2026-02-13T08:01:34.641 INFO:teuthology.orchestra.run.trial119.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-13T08:01:34.641 INFO:teuthology.orchestra.run.trial119.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1254 kB] 2026-02-13T08:01:34.667 INFO:teuthology.orchestra.run.trial104.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-13T08:01:34.670 INFO:teuthology.orchestra.run.trial119.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-13T08:01:34.673 INFO:teuthology.orchestra.run.trial104.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-13T08:01:34.673 INFO:teuthology.orchestra.run.trial104.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5260 kB] 2026-02-13T08:01:34.676 INFO:teuthology.orchestra.run.trial119.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-13T08:01:34.677 INFO:teuthology.orchestra.run.trial119.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5260 kB] 2026-02-13T08:01:34.800 INFO:teuthology.orchestra.run.trial104.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [991 kB] 2026-02-13T08:01:34.804 INFO:teuthology.orchestra.run.trial119.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [991 kB] 2026-02-13T08:01:34.819 INFO:teuthology.orchestra.run.trial104.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2959 kB] 2026-02-13T08:01:34.823 INFO:teuthology.orchestra.run.trial119.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2959 kB] 2026-02-13T08:01:34.889 INFO:teuthology.orchestra.run.trial104.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [425 kB] 2026-02-13T08:01:34.893 INFO:teuthology.orchestra.run.trial119.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [425 kB] 2026-02-13T08:01:34.897 INFO:teuthology.orchestra.run.trial104.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-13T08:01:34.897 INFO:teuthology.orchestra.run.trial104.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-13T08:01:34.900 INFO:teuthology.orchestra.run.trial119.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-13T08:01:34.900 INFO:teuthology.orchestra.run.trial119.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-13T08:01:34.924 INFO:teuthology.orchestra.run.trial104.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-13T08:01:34.929 INFO:teuthology.orchestra.run.trial119.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-13T08:01:34.931 INFO:teuthology.orchestra.run.trial104.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-13T08:01:34.931 INFO:teuthology.orchestra.run.trial104.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5089 kB] 2026-02-13T08:01:34.933 INFO:teuthology.orchestra.run.trial119.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-13T08:01:34.933 INFO:teuthology.orchestra.run.trial119.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5089 kB] 2026-02-13T08:01:35.050 INFO:teuthology.orchestra.run.trial104.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [963 kB] 2026-02-13T08:01:35.055 INFO:teuthology.orchestra.run.trial119.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [963 kB] 2026-02-13T08:01:38.356 INFO:teuthology.orchestra.run.trial104.stdout:Fetched 22.7 MB in 3s (8371 kB/s) 2026-02-13T08:01:38.384 INFO:teuthology.orchestra.run.trial119.stdout:Fetched 22.7 MB in 3s (8367 kB/s) 2026-02-13T08:01:38.882 INFO:teuthology.orchestra.run.trial104.stdout:Reading package lists... 2026-02-13T08:01:38.896 DEBUG:teuthology.orchestra.run.trial104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T08:01:38.909 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-13T08:01:38.923 DEBUG:teuthology.orchestra.run.trial119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T08:01:38.928 INFO:teuthology.orchestra.run.trial104.stdout:Reading package lists... 2026-02-13T08:01:38.997 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-13T08:01:39.033 INFO:teuthology.orchestra.run.trial104.stdout:Building dependency tree... 2026-02-13T08:01:39.034 INFO:teuthology.orchestra.run.trial104.stdout:Reading state information... 2026-02-13T08:01:39.102 INFO:teuthology.orchestra.run.trial119.stdout:Building dependency tree... 2026-02-13T08:01:39.102 INFO:teuthology.orchestra.run.trial119.stdout:Reading state information... 2026-02-13T08:01:39.120 INFO:teuthology.orchestra.run.trial104.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T08:01:39.120 INFO:teuthology.orchestra.run.trial104.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T08:01:39.120 INFO:teuthology.orchestra.run.trial104.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T08:01:39.120 INFO:teuthology.orchestra.run.trial104.stdout: sg3-utils-udev 2026-02-13T08:01:39.120 INFO:teuthology.orchestra.run.trial104.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T08:01:39.120 INFO:teuthology.orchestra.run.trial104.stdout:The following additional packages will be installed: 2026-02-13T08:01:39.120 INFO:teuthology.orchestra.run.trial104.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T08:01:39.120 INFO:teuthology.orchestra.run.trial104.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-13T08:01:39.120 INFO:teuthology.orchestra.run.trial104.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-13T08:01:39.121 INFO:teuthology.orchestra.run.trial104.stdout:Suggested packages: 2026-02-13T08:01:39.121 INFO:teuthology.orchestra.run.trial104.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-13T08:01:39.134 INFO:teuthology.orchestra.run.trial104.stdout:The following NEW packages will be installed: 2026-02-13T08:01:39.134 INFO:teuthology.orchestra.run.trial104.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T08:01:39.134 INFO:teuthology.orchestra.run.trial104.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-13T08:01:39.134 INFO:teuthology.orchestra.run.trial104.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-13T08:01:39.134 INFO:teuthology.orchestra.run.trial104.stdout:The following packages will be upgraded: 2026-02-13T08:01:39.134 INFO:teuthology.orchestra.run.trial104.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-13T08:01:39.191 INFO:teuthology.orchestra.run.trial119.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T08:01:39.191 INFO:teuthology.orchestra.run.trial119.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T08:01:39.191 INFO:teuthology.orchestra.run.trial119.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T08:01:39.191 INFO:teuthology.orchestra.run.trial119.stdout: sg3-utils-udev 2026-02-13T08:01:39.191 INFO:teuthology.orchestra.run.trial119.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T08:01:39.191 INFO:teuthology.orchestra.run.trial119.stdout:The following additional packages will be installed: 2026-02-13T08:01:39.192 INFO:teuthology.orchestra.run.trial119.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T08:01:39.192 INFO:teuthology.orchestra.run.trial119.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-13T08:01:39.192 INFO:teuthology.orchestra.run.trial119.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-13T08:01:39.192 INFO:teuthology.orchestra.run.trial119.stdout:Suggested packages: 2026-02-13T08:01:39.192 INFO:teuthology.orchestra.run.trial119.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-13T08:01:39.204 INFO:teuthology.orchestra.run.trial119.stdout:The following NEW packages will be installed: 2026-02-13T08:01:39.204 INFO:teuthology.orchestra.run.trial119.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T08:01:39.204 INFO:teuthology.orchestra.run.trial119.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-13T08:01:39.205 INFO:teuthology.orchestra.run.trial119.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-13T08:01:39.205 INFO:teuthology.orchestra.run.trial119.stdout:The following packages will be upgraded: 2026-02-13T08:01:39.205 INFO:teuthology.orchestra.run.trial119.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-13T08:01:39.299 INFO:teuthology.orchestra.run.trial119.stdout:3 upgraded, 5 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T08:01:39.299 INFO:teuthology.orchestra.run.trial119.stdout:Need to get 113 MB of archives. 2026-02-13T08:01:39.299 INFO:teuthology.orchestra.run.trial119.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-13T08:01:39.299 INFO:teuthology.orchestra.run.trial119.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-13T08:01:39.469 INFO:teuthology.orchestra.run.trial119.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-13T08:01:39.513 INFO:teuthology.orchestra.run.trial119.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-13T08:01:39.558 INFO:teuthology.orchestra.run.trial104.stdout:3 upgraded, 5 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T08:01:39.558 INFO:teuthology.orchestra.run.trial104.stdout:Need to get 113 MB of archives. 2026-02-13T08:01:39.558 INFO:teuthology.orchestra.run.trial104.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-13T08:01:39.558 INFO:teuthology.orchestra.run.trial104.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-13T08:01:39.756 INFO:teuthology.orchestra.run.trial119.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-13T08:01:39.756 INFO:teuthology.orchestra.run.trial119.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-13T08:01:39.756 INFO:teuthology.orchestra.run.trial119.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-13T08:01:39.805 INFO:teuthology.orchestra.run.trial119.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-13T08:01:39.816 INFO:teuthology.orchestra.run.trial119.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-13T08:01:40.015 INFO:teuthology.orchestra.run.trial119.stdout:Fetched 113 MB in 1s (186 MB/s) 2026-02-13T08:01:40.036 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-13T08:01:40.203 INFO:teuthology.orchestra.run.trial119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-13T08:01:40.205 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T08:01:40.206 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:40.546 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-13T08:01:40.553 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T08:01:40.574 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:40.615 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-13T08:01:40.621 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T08:01:40.621 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:40.943 INFO:teuthology.orchestra.run.trial104.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-13T08:01:41.283 INFO:teuthology.orchestra.run.trial104.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-13T08:01:41.729 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T08:01:41.730 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T08:01:41.752 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T08:01:41.753 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T08:01:41.768 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-13T08:01:41.775 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-13T08:01:41.776 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T08:01:43.144 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-13T08:01:43.156 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T08:01:43.157 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:43.170 INFO:teuthology.orchestra.run.trial104.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-13T08:01:43.170 INFO:teuthology.orchestra.run.trial104.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-13T08:01:43.170 INFO:teuthology.orchestra.run.trial104.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-13T08:01:43.526 INFO:teuthology.orchestra.run.trial104.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-13T08:01:43.608 INFO:teuthology.orchestra.run.trial104.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-13T08:01:43.742 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T08:01:43.743 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T08:01:43.768 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T08:01:43.770 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:43.771 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-13T08:01:43.772 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:43.806 INFO:teuthology.orchestra.run.trial104.stdout:Fetched 113 MB in 4s (25.4 MB/s) 2026-02-13T08:01:43.822 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-13T08:01:43.987 INFO:teuthology.orchestra.run.trial104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-13T08:01:43.988 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T08:01:43.990 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:44.349 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-13T08:01:44.356 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T08:01:44.378 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:44.419 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-13T08:01:44.426 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T08:01:44.426 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:44.545 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:45.370 INFO:teuthology.orchestra.run.trial119.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-13T08:01:45.370 INFO:teuthology.orchestra.run.trial119.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-13T08:01:45.375 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:45.534 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T08:01:45.535 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T08:01:45.557 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T08:01:45.558 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T08:01:45.574 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-13T08:01:45.581 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-13T08:01:45.582 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T08:01:46.166 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-13T08:01:46.167 INFO:teuthology.orchestra.run.trial119.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-13T08:01:46.168 INFO:teuthology.orchestra.run.trial119.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:46.173 INFO:teuthology.orchestra.run.trial119.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-13T08:01:46.174 INFO:teuthology.orchestra.run.trial119.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-13T08:01:46.925 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-13T08:01:46.937 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T08:01:46.937 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:47.531 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T08:01:47.532 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T08:01:47.557 INFO:teuthology.orchestra.run.trial104.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T08:01:47.559 INFO:teuthology.orchestra.run.trial104.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:47.560 INFO:teuthology.orchestra.run.trial104.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-13T08:01:47.562 INFO:teuthology.orchestra.run.trial104.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:48.347 INFO:teuthology.orchestra.run.trial104.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:49.194 INFO:teuthology.orchestra.run.trial104.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-13T08:01:49.195 INFO:teuthology.orchestra.run.trial104.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-13T08:01:49.200 INFO:teuthology.orchestra.run.trial104.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:50.013 INFO:teuthology.orchestra.run.trial104.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-13T08:01:50.014 INFO:teuthology.orchestra.run.trial104.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-13T08:01:50.015 INFO:teuthology.orchestra.run.trial104.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T08:01:50.020 INFO:teuthology.orchestra.run.trial104.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-13T08:01:50.020 INFO:teuthology.orchestra.run.trial104.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-13T08:01:53.233 INFO:teuthology.orchestra.run.trial119.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-13T08:01:57.098 INFO:teuthology.orchestra.run.trial104.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-13T08:01:59.844 INFO:teuthology.orchestra.run.trial119.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-13T08:01:59.844 INFO:teuthology.orchestra.run.trial119.stdout:Sourcing file `/etc/default/grub' 2026-02-13T08:01:59.862 INFO:teuthology.orchestra.run.trial119.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T08:01:59.863 INFO:teuthology.orchestra.run.trial119.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T08:01:59.865 INFO:teuthology.orchestra.run.trial119.stdout:Generating grub configuration file ... 2026-02-13T08:01:59.946 INFO:teuthology.orchestra.run.trial119.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T08:01:59.953 INFO:teuthology.orchestra.run.trial119.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T08:02:00.128 INFO:teuthology.orchestra.run.trial119.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T08:02:00.133 INFO:teuthology.orchestra.run.trial119.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T08:02:00.206 INFO:teuthology.orchestra.run.trial119.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T08:02:00.206 INFO:teuthology.orchestra.run.trial119.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T08:02:00.206 INFO:teuthology.orchestra.run.trial119.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T08:02:00.208 INFO:teuthology.orchestra.run.trial119.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T08:02:00.217 INFO:teuthology.orchestra.run.trial119.stdout:done 2026-02-13T08:02:00.677 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:02:00.677 INFO:teuthology.orchestra.run.trial119.stdout:Pending kernel upgrade! 2026-02-13T08:02:00.677 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout:Running kernel version: 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout: 5.15.0-164-generic 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout:Diagnostics: 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout:The processor microcode seems to be up-to-date. 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout:No services need to be restarted. 2026-02-13T08:02:00.678 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:02:00.679 INFO:teuthology.orchestra.run.trial119.stdout:No containers need to be restarted. 2026-02-13T08:02:00.679 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:02:00.679 INFO:teuthology.orchestra.run.trial119.stdout:No user sessions are running outdated binaries. 2026-02-13T08:02:00.679 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:02:00.679 INFO:teuthology.orchestra.run.trial119.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T08:02:01.327 DEBUG:teuthology.orchestra.run.trial119:> dpkg -s linux-image-generic 2026-02-13T08:02:01.337 INFO:teuthology.orchestra.run.trial119.stdout:Package: linux-image-generic 2026-02-13T08:02:01.337 INFO:teuthology.orchestra.run.trial119.stdout:Status: install ok installed 2026-02-13T08:02:01.338 INFO:teuthology.orchestra.run.trial119.stdout:Priority: optional 2026-02-13T08:02:01.338 INFO:teuthology.orchestra.run.trial119.stdout:Section: kernel 2026-02-13T08:02:01.338 INFO:teuthology.orchestra.run.trial119.stdout:Installed-Size: 21 2026-02-13T08:02:01.338 INFO:teuthology.orchestra.run.trial119.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T08:02:01.338 INFO:teuthology.orchestra.run.trial119.stdout:Architecture: amd64 2026-02-13T08:02:01.338 INFO:teuthology.orchestra.run.trial119.stdout:Source: linux-meta 2026-02-13T08:02:01.338 INFO:teuthology.orchestra.run.trial119.stdout:Version: 5.15.0.170.159 2026-02-13T08:02:01.338 INFO:teuthology.orchestra.run.trial119.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T08:02:01.338 INFO:teuthology.orchestra.run.trial119.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T08:02:01.338 INFO:teuthology.orchestra.run.trial119.stdout:Recommends: thermald 2026-02-13T08:02:01.339 INFO:teuthology.orchestra.run.trial119.stdout:Description: Generic Linux kernel image 2026-02-13T08:02:01.339 INFO:teuthology.orchestra.run.trial119.stdout: This package will always depend on the latest generic kernel image 2026-02-13T08:02:01.339 INFO:teuthology.orchestra.run.trial119.stdout: available. 2026-02-13T08:02:01.339 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-13T08:02:01.339 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T08:02:01.339 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T08:02:01.339 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2026-02-13T08:02:01.340 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial119.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T08:02:01.340 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get clean 2026-02-13T08:02:01.420 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get update 2026-02-13T08:02:01.850 INFO:teuthology.orchestra.run.trial119.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T08:02:01.917 INFO:teuthology.orchestra.run.trial119.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T08:02:01.989 INFO:teuthology.orchestra.run.trial119.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T08:02:02.062 INFO:teuthology.orchestra.run.trial119.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T08:02:02.711 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-13T08:02:02.725 DEBUG:teuthology.orchestra.run.trial119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T08:02:02.758 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-13T08:02:02.864 INFO:teuthology.orchestra.run.trial119.stdout:Building dependency tree... 2026-02-13T08:02:02.865 INFO:teuthology.orchestra.run.trial119.stdout:Reading state information... 2026-02-13T08:02:02.949 INFO:teuthology.orchestra.run.trial119.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-13T08:02:02.949 INFO:teuthology.orchestra.run.trial119.stdout:linux-image-generic set to manually installed. 2026-02-13T08:02:02.949 INFO:teuthology.orchestra.run.trial119.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T08:02:02.950 INFO:teuthology.orchestra.run.trial119.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T08:02:02.950 INFO:teuthology.orchestra.run.trial119.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T08:02:02.950 INFO:teuthology.orchestra.run.trial119.stdout: sg3-utils-udev 2026-02-13T08:02:02.950 INFO:teuthology.orchestra.run.trial119.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T08:02:02.969 INFO:teuthology.orchestra.run.trial119.stdout:0 upgraded, 0 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T08:02:02.971 DEBUG:teuthology.orchestra.run.trial119:> dpkg -s linux-image-generic 2026-02-13T08:02:03.022 INFO:teuthology.orchestra.run.trial119.stdout:Package: linux-image-generic 2026-02-13T08:02:03.022 INFO:teuthology.orchestra.run.trial119.stdout:Status: install ok installed 2026-02-13T08:02:03.022 INFO:teuthology.orchestra.run.trial119.stdout:Priority: optional 2026-02-13T08:02:03.022 INFO:teuthology.orchestra.run.trial119.stdout:Section: kernel 2026-02-13T08:02:03.022 INFO:teuthology.orchestra.run.trial119.stdout:Installed-Size: 21 2026-02-13T08:02:03.022 INFO:teuthology.orchestra.run.trial119.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T08:02:03.022 INFO:teuthology.orchestra.run.trial119.stdout:Architecture: amd64 2026-02-13T08:02:03.022 INFO:teuthology.orchestra.run.trial119.stdout:Source: linux-meta 2026-02-13T08:02:03.022 INFO:teuthology.orchestra.run.trial119.stdout:Version: 5.15.0.170.159 2026-02-13T08:02:03.023 INFO:teuthology.orchestra.run.trial119.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T08:02:03.023 INFO:teuthology.orchestra.run.trial119.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T08:02:03.023 INFO:teuthology.orchestra.run.trial119.stdout:Recommends: thermald 2026-02-13T08:02:03.023 INFO:teuthology.orchestra.run.trial119.stdout:Description: Generic Linux kernel image 2026-02-13T08:02:03.023 INFO:teuthology.orchestra.run.trial119.stdout: This package will always depend on the latest generic kernel image 2026-02-13T08:02:03.023 INFO:teuthology.orchestra.run.trial119.stdout: available. 2026-02-13T08:02:03.024 DEBUG:teuthology.orchestra.run.trial119:> mktemp 2026-02-13T08:02:03.069 INFO:teuthology.orchestra.run.trial119.stdout:/tmp/tmp.axJ4bQ7WTK 2026-02-13T08:02:03.069 DEBUG:teuthology.orchestra.run.trial119:> sudo cp /boot/grub/grub.cfg /tmp/tmp.axJ4bQ7WTK 2026-02-13T08:02:03.117 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 0666 /tmp/tmp.axJ4bQ7WTK 2026-02-13T08:02:03.216 DEBUG:teuthology.orchestra.remote:trial119:/tmp/tmp.axJ4bQ7WTK is 7KB 2026-02-13T08:02:03.269 DEBUG:teuthology.orchestra.run.trial119:> rm -fr /tmp/tmp.axJ4bQ7WTK 2026-02-13T08:02:03.274 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-13T08:02:03.325 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:02:03.326 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-13T08:02:03.326 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-13T08:02:03.383 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-13T08:02:03.383 DEBUG:teuthology.orchestra.run.trial119:> sudo update-grub 2026-02-13T08:02:03.640 INFO:teuthology.orchestra.run.trial119.stderr:Sourcing file `/etc/default/grub' 2026-02-13T08:02:03.658 INFO:teuthology.orchestra.run.trial119.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T08:02:03.659 INFO:teuthology.orchestra.run.trial119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T08:02:03.661 INFO:teuthology.orchestra.run.trial119.stderr:Generating grub configuration file ... 2026-02-13T08:02:03.707 INFO:teuthology.orchestra.run.trial104.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-13T08:02:03.707 INFO:teuthology.orchestra.run.trial104.stdout:Sourcing file `/etc/default/grub' 2026-02-13T08:02:03.726 INFO:teuthology.orchestra.run.trial104.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T08:02:03.727 INFO:teuthology.orchestra.run.trial104.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T08:02:03.729 INFO:teuthology.orchestra.run.trial104.stdout:Generating grub configuration file ... 2026-02-13T08:02:03.742 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T08:02:03.748 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T08:02:03.812 INFO:teuthology.orchestra.run.trial104.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T08:02:03.819 INFO:teuthology.orchestra.run.trial104.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T08:02:03.925 INFO:teuthology.orchestra.run.trial119.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T08:02:03.931 INFO:teuthology.orchestra.run.trial119.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T08:02:03.989 INFO:teuthology.orchestra.run.trial104.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T08:02:03.994 INFO:teuthology.orchestra.run.trial104.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T08:02:04.001 INFO:teuthology.orchestra.run.trial119.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T08:02:04.001 INFO:teuthology.orchestra.run.trial119.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T08:02:04.001 INFO:teuthology.orchestra.run.trial119.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T08:02:04.004 INFO:teuthology.orchestra.run.trial119.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T08:02:04.011 INFO:teuthology.orchestra.run.trial119.stderr:done 2026-02-13T08:02:04.013 DEBUG:teuthology.orchestra.run.trial119:> sudo shutdown -r now 2026-02-13T08:02:04.067 INFO:teuthology.orchestra.run.trial104.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T08:02:04.067 INFO:teuthology.orchestra.run.trial104.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T08:02:04.067 INFO:teuthology.orchestra.run.trial104.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T08:02:04.069 INFO:teuthology.orchestra.run.trial104.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T08:02:04.077 INFO:teuthology.orchestra.run.trial104.stdout:done 2026-02-13T08:02:04.485 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:02:04.486 INFO:teuthology.orchestra.run.trial104.stdout:Pending kernel upgrade! 2026-02-13T08:02:04.486 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:02:04.486 INFO:teuthology.orchestra.run.trial104.stdout:Running kernel version: 2026-02-13T08:02:04.486 INFO:teuthology.orchestra.run.trial104.stdout: 5.15.0-164-generic 2026-02-13T08:02:04.486 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:02:04.486 INFO:teuthology.orchestra.run.trial104.stdout:Diagnostics: 2026-02-13T08:02:04.487 INFO:teuthology.orchestra.run.trial104.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-13T08:02:04.487 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:02:04.487 INFO:teuthology.orchestra.run.trial104.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-13T08:02:04.487 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:02:04.487 INFO:teuthology.orchestra.run.trial104.stdout:The processor microcode seems to be up-to-date. 2026-02-13T08:02:04.487 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:02:04.487 INFO:teuthology.orchestra.run.trial104.stdout:No services need to be restarted. 2026-02-13T08:02:04.488 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:02:04.488 INFO:teuthology.orchestra.run.trial104.stdout:No containers need to be restarted. 2026-02-13T08:02:04.488 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:02:04.488 INFO:teuthology.orchestra.run.trial104.stdout:No user sessions are running outdated binaries. 2026-02-13T08:02:04.488 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:02:04.488 INFO:teuthology.orchestra.run.trial104.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T08:02:05.144 DEBUG:teuthology.orchestra.run.trial104:> dpkg -s linux-image-generic 2026-02-13T08:02:05.154 INFO:teuthology.orchestra.run.trial104.stdout:Package: linux-image-generic 2026-02-13T08:02:05.154 INFO:teuthology.orchestra.run.trial104.stdout:Status: install ok installed 2026-02-13T08:02:05.154 INFO:teuthology.orchestra.run.trial104.stdout:Priority: optional 2026-02-13T08:02:05.154 INFO:teuthology.orchestra.run.trial104.stdout:Section: kernel 2026-02-13T08:02:05.154 INFO:teuthology.orchestra.run.trial104.stdout:Installed-Size: 21 2026-02-13T08:02:05.154 INFO:teuthology.orchestra.run.trial104.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T08:02:05.154 INFO:teuthology.orchestra.run.trial104.stdout:Architecture: amd64 2026-02-13T08:02:05.154 INFO:teuthology.orchestra.run.trial104.stdout:Source: linux-meta 2026-02-13T08:02:05.154 INFO:teuthology.orchestra.run.trial104.stdout:Version: 5.15.0.170.159 2026-02-13T08:02:05.155 INFO:teuthology.orchestra.run.trial104.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T08:02:05.155 INFO:teuthology.orchestra.run.trial104.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T08:02:05.155 INFO:teuthology.orchestra.run.trial104.stdout:Recommends: thermald 2026-02-13T08:02:05.155 INFO:teuthology.orchestra.run.trial104.stdout:Description: Generic Linux kernel image 2026-02-13T08:02:05.155 INFO:teuthology.orchestra.run.trial104.stdout: This package will always depend on the latest generic kernel image 2026-02-13T08:02:05.155 INFO:teuthology.orchestra.run.trial104.stdout: available. 2026-02-13T08:02:05.155 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-13T08:02:05.155 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T08:02:05.156 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T08:02:05.156 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-13T08:02:05.156 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial104.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T08:02:05.156 DEBUG:teuthology.orchestra.run.trial104:> sudo apt-get clean 2026-02-13T08:02:05.235 DEBUG:teuthology.orchestra.run.trial104:> sudo apt-get update 2026-02-13T08:02:05.406 INFO:teuthology.orchestra.run.trial104.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T08:02:05.411 INFO:teuthology.orchestra.run.trial104.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T08:02:05.420 INFO:teuthology.orchestra.run.trial104.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T08:02:05.429 INFO:teuthology.orchestra.run.trial104.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T08:02:06.253 INFO:teuthology.orchestra.run.trial104.stdout:Reading package lists... 2026-02-13T08:02:06.267 DEBUG:teuthology.orchestra.run.trial104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T08:02:06.301 INFO:teuthology.orchestra.run.trial104.stdout:Reading package lists... 2026-02-13T08:02:06.411 INFO:teuthology.orchestra.run.trial104.stdout:Building dependency tree... 2026-02-13T08:02:06.412 INFO:teuthology.orchestra.run.trial104.stdout:Reading state information... 2026-02-13T08:02:06.496 INFO:teuthology.orchestra.run.trial104.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-13T08:02:06.496 INFO:teuthology.orchestra.run.trial104.stdout:linux-image-generic set to manually installed. 2026-02-13T08:02:06.496 INFO:teuthology.orchestra.run.trial104.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T08:02:06.496 INFO:teuthology.orchestra.run.trial104.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T08:02:06.496 INFO:teuthology.orchestra.run.trial104.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T08:02:06.496 INFO:teuthology.orchestra.run.trial104.stdout: sg3-utils-udev 2026-02-13T08:02:06.497 INFO:teuthology.orchestra.run.trial104.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T08:02:06.516 INFO:teuthology.orchestra.run.trial104.stdout:0 upgraded, 0 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T08:02:06.518 DEBUG:teuthology.orchestra.run.trial104:> dpkg -s linux-image-generic 2026-02-13T08:02:06.569 INFO:teuthology.orchestra.run.trial104.stdout:Package: linux-image-generic 2026-02-13T08:02:06.569 INFO:teuthology.orchestra.run.trial104.stdout:Status: install ok installed 2026-02-13T08:02:06.569 INFO:teuthology.orchestra.run.trial104.stdout:Priority: optional 2026-02-13T08:02:06.570 INFO:teuthology.orchestra.run.trial104.stdout:Section: kernel 2026-02-13T08:02:06.570 INFO:teuthology.orchestra.run.trial104.stdout:Installed-Size: 21 2026-02-13T08:02:06.570 INFO:teuthology.orchestra.run.trial104.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T08:02:06.570 INFO:teuthology.orchestra.run.trial104.stdout:Architecture: amd64 2026-02-13T08:02:06.570 INFO:teuthology.orchestra.run.trial104.stdout:Source: linux-meta 2026-02-13T08:02:06.570 INFO:teuthology.orchestra.run.trial104.stdout:Version: 5.15.0.170.159 2026-02-13T08:02:06.570 INFO:teuthology.orchestra.run.trial104.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T08:02:06.570 INFO:teuthology.orchestra.run.trial104.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T08:02:06.570 INFO:teuthology.orchestra.run.trial104.stdout:Recommends: thermald 2026-02-13T08:02:06.570 INFO:teuthology.orchestra.run.trial104.stdout:Description: Generic Linux kernel image 2026-02-13T08:02:06.570 INFO:teuthology.orchestra.run.trial104.stdout: This package will always depend on the latest generic kernel image 2026-02-13T08:02:06.571 INFO:teuthology.orchestra.run.trial104.stdout: available. 2026-02-13T08:02:06.571 DEBUG:teuthology.orchestra.run.trial104:> mktemp 2026-02-13T08:02:06.616 INFO:teuthology.orchestra.run.trial104.stdout:/tmp/tmp.CFDjS9XW16 2026-02-13T08:02:06.616 DEBUG:teuthology.orchestra.run.trial104:> sudo cp /boot/grub/grub.cfg /tmp/tmp.CFDjS9XW16 2026-02-13T08:02:06.668 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod 0666 /tmp/tmp.CFDjS9XW16 2026-02-13T08:02:06.766 DEBUG:teuthology.orchestra.remote:trial104:/tmp/tmp.CFDjS9XW16 is 7KB 2026-02-13T08:02:06.774 DEBUG:teuthology.orchestra.run.trial104:> rm -fr /tmp/tmp.CFDjS9XW16 2026-02-13T08:02:06.778 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-13T08:02:06.828 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:02:06.828 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-13T08:02:06.828 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-13T08:02:06.886 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-13T08:02:06.886 DEBUG:teuthology.orchestra.run.trial104:> sudo update-grub 2026-02-13T08:02:07.127 INFO:teuthology.orchestra.run.trial104.stderr:Sourcing file `/etc/default/grub' 2026-02-13T08:02:07.145 INFO:teuthology.orchestra.run.trial104.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T08:02:07.146 INFO:teuthology.orchestra.run.trial104.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T08:02:07.148 INFO:teuthology.orchestra.run.trial104.stderr:Generating grub configuration file ... 2026-02-13T08:02:07.231 INFO:teuthology.orchestra.run.trial104.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T08:02:07.236 INFO:teuthology.orchestra.run.trial104.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T08:02:07.410 INFO:teuthology.orchestra.run.trial104.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T08:02:07.416 INFO:teuthology.orchestra.run.trial104.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T08:02:07.487 INFO:teuthology.orchestra.run.trial104.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T08:02:07.487 INFO:teuthology.orchestra.run.trial104.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T08:02:07.487 INFO:teuthology.orchestra.run.trial104.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T08:02:07.489 INFO:teuthology.orchestra.run.trial104.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T08:02:07.496 INFO:teuthology.orchestra.run.trial104.stderr:done 2026-02-13T08:02:07.499 DEBUG:teuthology.orchestra.run.trial104:> sudo shutdown -r now 2026-02-13T08:02:34.042 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2026-02-13T08:02:34.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-13T08:02:34.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T08:02:37.505 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-13T08:02:37.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-13T08:02:37.506 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T08:02:48.349 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.119 2026-02-13T08:02:51.805 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.104 2026-02-13T08:02:57.355 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-13T08:02:57.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T08:03:00.809 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-13T08:03:00.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T08:03:33.278 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-13T08:03:33.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-13T08:03:33.665 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-170-generic"... 2026-02-13T08:03:33.665 DEBUG:teuthology.orchestra.run.trial119:> uname -r 2026-02-13T08:03:33.710 INFO:teuthology.orchestra.run.trial119.stdout:5.15.0-170-generic 2026-02-13T08:03:33.710 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-13T08:03:33.710 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T08:03:33.710 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-13T08:03:34.711 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2026-02-13T08:03:34.711 DEBUG:teuthology.orchestra.run.trial119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-13T08:03:34.724 INFO:teuthology.orchestra.run.trial119.stdout:ttyS1 2026-02-13T08:03:34.748 DEBUG:teuthology.parallel:result is None 2026-02-13T08:03:36.859 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-13T08:03:37.250 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-13T08:03:37.251 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-13T08:03:37.251 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-13T08:03:37.296 INFO:teuthology.orchestra.run.trial104.stdout:5.15.0-170-generic 2026-02-13T08:03:37.297 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-13T08:03:37.297 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T08:03:37.297 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-13T08:03:38.298 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-13T08:03:38.298 DEBUG:teuthology.orchestra.run.trial104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-13T08:03:38.312 INFO:teuthology.orchestra.run.trial104.stdout:ttyS1 2026-02-13T08:03:38.346 DEBUG:teuthology.parallel:result is None 2026-02-13T08:03:38.346 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T08:03:38.355 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T08:03:38.356 DEBUG:teuthology.orchestra.run.trial104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T08:03:38.390 DEBUG:teuthology.orchestra.run.trial119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T08:03:38.396 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T08:03:38.410 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T08:03:38.427 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T08:03:38.427 DEBUG:teuthology.orchestra.run.trial104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T08:03:38.438 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T08:03:38.452 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T08:03:38.466 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T08:03:38.467 DEBUG:teuthology.orchestra.run.trial104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T08:03:38.486 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T08:03:38.494 INFO:teuthology.orchestra.run.trial104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T08:03:38.496 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T08:03:38.501 INFO:teuthology.orchestra.run.trial104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T08:03:38.503 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T08:03:38.504 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T08:03:38.517 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T08:03:38.518 DEBUG:teuthology.orchestra.run.trial104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T08:03:38.546 DEBUG:teuthology.orchestra.run.trial119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T08:03:38.555 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T08:03:38.573 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T08:03:38.573 DEBUG:teuthology.orchestra.run.trial104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T08:03:38.598 DEBUG:teuthology.orchestra.run.trial119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T08:03:38.606 DEBUG:teuthology.orchestra.run.trial104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T08:03:38.644 DEBUG:teuthology.orchestra.run.trial104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T08:03:38.692 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:03:38.692 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T08:03:38.740 DEBUG:teuthology.orchestra.run.trial119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T08:03:38.745 DEBUG:teuthology.orchestra.run.trial119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T08:03:38.790 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:03:38.790 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T08:03:38.838 DEBUG:teuthology.orchestra.run.trial104:> sudo service rsyslog restart 2026-02-13T08:03:38.841 DEBUG:teuthology.orchestra.run.trial119:> sudo service rsyslog restart 2026-02-13T08:03:38.895 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T08:03:38.908 INFO:teuthology.task.internal:Starting timer... 2026-02-13T08:03:38.908 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T08:03:38.930 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T08:03:38.948 DEBUG:teuthology.task.selinux:Excluding trial104: OS 'ubuntu' does not support SELinux 2026-02-13T08:03:38.948 DEBUG:teuthology.task.selinux:Excluding trial119: OS 'ubuntu' does not support SELinux 2026-02-13T08:03:38.948 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T08:03:38.949 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-13T08:03:38.949 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T08:03:38.949 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T08:03:38.964 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T08:03:38.977 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T08:03:38.978 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial104.front.sepia.ceph.com,trial119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T08:04:41.143 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial104.front.sepia.ceph.com'), Remote(name='ubuntu@trial119.front.sepia.ceph.com')] 2026-02-13T08:04:41.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-13T08:04:41.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T08:04:41.257 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-13T08:04:41.513 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-13T08:04:41.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-13T08:04:41.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T08:04:41.621 DEBUG:teuthology.orchestra.run.trial119:> true 2026-02-13T08:04:41.866 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial119.front.sepia.ceph.com' 2026-02-13T08:04:41.867 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T08:04:41.879 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T08:04:41.879 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T08:04:41.880 DEBUG:teuthology.orchestra.run.trial104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T08:04:41.882 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T08:04:41.882 DEBUG:teuthology.orchestra.run.trial119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T08:04:41.899 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-13T08:04:41.899 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: Command line: ntpd -gq 2026-02-13T08:04:41.899 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: ---------------------------------------------------- 2026-02-13T08:04:41.899 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: ntp-4 is maintained by Network Time Foundation, 2026-02-13T08:04:41.899 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-13T08:04:41.899 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: corporation. Support and training for ntp-4 are 2026-02-13T08:04:41.899 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: available at https://www.nwtime.org/support 2026-02-13T08:04:41.899 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: ---------------------------------------------------- 2026-02-13T08:04:41.900 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: proto: precision = 0.030 usec (-25) 2026-02-13T08:04:41.900 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: basedate set to 2022-02-04 2026-02-13T08:04:41.900 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: gps base set to 2022-02-06 (week 2196) 2026-02-13T08:04:41.900 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T08:04:41.900 INFO:teuthology.orchestra.run.trial104.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T08:04:41.900 INFO:teuthology.orchestra.run.trial104.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-13T08:04:41.901 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: restrict ::: KOD does nothing without LIMITED. 2026-02-13T08:04:41.902 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: Listen and drop on 0 v6wildcard [::]:123 2026-02-13T08:04:41.902 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-13T08:04:41.902 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: Listen normally on 2 lo 127.0.0.1:123 2026-02-13T08:04:41.902 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: Listen normally on 3 enp1s0f0 10.20.193.104:123 2026-02-13T08:04:41.902 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: Listen normally on 4 lo [::1]:123 2026-02-13T08:04:41.902 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:645e%2]:123 2026-02-13T08:04:41.902 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:41 ntpd[4905]: Listening on routing socket on fd #22 for interface updates 2026-02-13T08:04:41.925 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-13T08:04:41.925 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: Command line: ntpd -gq 2026-02-13T08:04:41.926 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: ---------------------------------------------------- 2026-02-13T08:04:41.926 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: ntp-4 is maintained by Network Time Foundation, 2026-02-13T08:04:41.926 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-13T08:04:41.926 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: corporation. Support and training for ntp-4 are 2026-02-13T08:04:41.926 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: available at https://www.nwtime.org/support 2026-02-13T08:04:41.926 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: ---------------------------------------------------- 2026-02-13T08:04:41.926 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: proto: precision = 0.030 usec (-25) 2026-02-13T08:04:41.926 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: basedate set to 2022-02-04 2026-02-13T08:04:41.926 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: gps base set to 2022-02-06 (week 2196) 2026-02-13T08:04:41.926 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T08:04:41.927 INFO:teuthology.orchestra.run.trial119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T08:04:41.927 INFO:teuthology.orchestra.run.trial119.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-13T08:04:41.928 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: restrict ::: KOD does nothing without LIMITED. 2026-02-13T08:04:41.928 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: Listen and drop on 0 v6wildcard [::]:123 2026-02-13T08:04:41.928 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-13T08:04:41.928 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: Listen normally on 2 lo 127.0.0.1:123 2026-02-13T08:04:41.928 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: Listen normally on 3 enp1s0f0 10.20.193.119:123 2026-02-13T08:04:41.928 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: Listen normally on 4 lo [::1]:123 2026-02-13T08:04:41.928 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:6132%2]:123 2026-02-13T08:04:41.929 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:42 ntpd[4895]: Listening on routing socket on fd #22 for interface updates 2026-02-13T08:04:42.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:42.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:42.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:42.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:42.908 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:42.908 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:42.908 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:42.908 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:42.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:43 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:42.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:43 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:42.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:43 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:42.958 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:43 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:42.958 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:43 ntpd[4895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:42.958 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:43 ntpd[4895]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:42.962 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:42.962 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:42.963 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:42.963 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:42 ntpd[4905]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:43.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:44 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:43.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:44 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:43.935 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:44 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:43.935 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:44 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:43.935 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:44 ntpd[4895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:43.936 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:44 ntpd[4895]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:44.898 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:44.898 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:44.898 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:44.898 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:44.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:44.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:44.907 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:44.907 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:44.907 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:44.908 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:44.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:45 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:44.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:45 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:44.930 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:44.930 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:44.930 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:44.931 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:44.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:45 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:44.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:45 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:44.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:45 ntpd[4895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:44.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:45 ntpd[4895]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:44.962 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:44.962 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:44.962 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:44.962 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:44 ntpd[4905]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:45.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:45.926 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:45.926 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:45.926 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:45.926 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:45.926 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:45.934 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:45.934 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:45.934 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:45.934 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:45.935 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:45.935 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:45.935 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:45.935 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:45.990 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:45.991 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:45.991 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:45.991 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:46 ntpd[4895]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:46.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:46.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:46.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:46.900 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:46.900 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:46.900 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:46.900 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:46.900 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:46.908 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:46.908 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:46.909 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:46.909 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:46.909 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:46.909 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:46.909 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:46.909 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:46.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:47 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:46.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:47 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:46.930 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:46.930 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:46.930 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:46.930 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:46.956 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:47 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:46.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:47 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:46.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:47 ntpd[4895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:46.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:47 ntpd[4895]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:46.962 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:46.962 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:46.962 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:46.962 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:46 ntpd[4905]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:47.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:47.926 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:47.926 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:47.926 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:47.926 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:47.926 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:47.933 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:47.934 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:47.934 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:47.934 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:47.935 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:47.935 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:47.935 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:47.935 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:47.990 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:47.990 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:47.990 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:47.990 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:48 ntpd[4895]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:48.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:48.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:48.899 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:48.900 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:48.900 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:48.900 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:48.900 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:48.900 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:48.908 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:48.908 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:48.908 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:48.908 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:48.909 INFO:teuthology.orchestra.run.trial104.stdout:13 Feb 08:04:48 ntpd[4905]: ntpd: time set +0.807299 s 2026-02-13T08:04:48.909 INFO:teuthology.orchestra.run.trial104.stdout:ntpd: time set +0.807299s 2026-02-13T08:04:48.909 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-13T08:04:48.909 INFO:teuthology.orchestra.run.trial104.stderr:13 Feb 08:04:48 ntpd[4905]: can't open /var/log/ntpstats/loopstats.20260213: Permission denied 2026-02-13T08:04:48.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:49 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:48.925 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:49 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:48.932 INFO:teuthology.orchestra.run.trial104.stdout:No association ID's returned 2026-02-13T08:04:48.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:49 ntpd[4895]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T08:04:48.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:49 ntpd[4895]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T08:04:48.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:49 ntpd[4895]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T08:04:48.957 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:49 ntpd[4895]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T08:04:48.958 INFO:teuthology.orchestra.run.trial119.stdout:13 Feb 08:04:49 ntpd[4895]: ntpd: time set -0.420197 s 2026-02-13T08:04:48.958 INFO:teuthology.orchestra.run.trial119.stdout:ntpd: time set -0.420197s 2026-02-13T08:04:48.958 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:49 ntpd[4895]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-13T08:04:48.958 INFO:teuthology.orchestra.run.trial119.stderr:13 Feb 08:04:49 ntpd[4895]: can't open /var/log/ntpstats/loopstats.20260213: Permission denied 2026-02-13T08:04:49.016 INFO:teuthology.orchestra.run.trial119.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T08:04:49.017 INFO:teuthology.orchestra.run.trial119.stdout:============================================================================== 2026-02-13T08:04:49.017 INFO:teuthology.orchestra.run.trial119.stdout: 73.185.182.209 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T08:04:49.017 INFO:teuthology.orchestra.run.trial119.stdout: 139-177-202-26. .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T08:04:49.017 INFO:teuthology.orchestra.run.trial119.stdout: clover0.mattnor .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T08:04:49.017 INFO:teuthology.orchestra.run.trial119.stdout: 149.248.12.167 .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T08:04:49.018 INFO:teuthology.run_tasks:Running task install... 2026-02-13T08:04:49.033 DEBUG:teuthology.task.install:project ceph 2026-02-13T08:04:49.033 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'}} 2026-02-13T08:04:49.034 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'} 2026-02-13T08:04:49.034 INFO:teuthology.task.install:Using flavor: default 2026-02-13T08:04:49.042 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T08:04:49.042 INFO:teuthology.task.install:extra packages: [] 2026-02-13T08:04:49.043 DEBUG:teuthology.orchestra.run.trial104:> sudo apt-key list | grep Ceph 2026-02-13T08:04:49.043 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-key list | grep Ceph 2026-02-13T08:04:49.095 INFO:teuthology.orchestra.run.trial104.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-13T08:04:49.106 INFO:teuthology.orchestra.run.trial119.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-13T08:04:49.123 INFO:teuthology.orchestra.run.trial104.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-13T08:04:49.123 INFO:teuthology.orchestra.run.trial104.stdout:uid [ unknown] Ceph.com (release key) 2026-02-13T08:04:49.124 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-13T08:04:49.125 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T08:04:49.136 INFO:teuthology.orchestra.run.trial119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-13T08:04:49.136 INFO:teuthology.orchestra.run.trial119.stdout:uid [ unknown] Ceph.com (release key) 2026-02-13T08:04:49.136 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-13T08:04:49.137 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T08:04:49.321 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default/ 2026-02-13T08:04:49.321 INFO:teuthology.task.install.deb:Package version is 20.2.0-636-g3b40640f-1jammy 2026-02-13T08:04:49.331 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default/ 2026-02-13T08:04:49.332 INFO:teuthology.task.install.deb:Package version is 20.2.0-636-g3b40640f-1jammy 2026-02-13T08:04:49.485 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:04:49.485 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-13T08:04:49.495 DEBUG:teuthology.orchestra.run.trial104:> sudo apt-get update 2026-02-13T08:04:49.496 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:04:49.496 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-13T08:04:49.504 DEBUG:teuthology.orchestra.run.trial119:> sudo apt-get update 2026-02-13T08:04:49.652 INFO:teuthology.orchestra.run.trial119.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy InRelease 2026-02-13T08:04:49.653 INFO:teuthology.orchestra.run.trial104.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy InRelease 2026-02-13T08:04:49.664 INFO:teuthology.orchestra.run.trial104.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy Release [7680 B] 2026-02-13T08:04:49.664 INFO:teuthology.orchestra.run.trial119.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy Release [7680 B] 2026-02-13T08:04:49.675 INFO:teuthology.orchestra.run.trial104.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-13T08:04:49.676 INFO:teuthology.orchestra.run.trial119.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-13T08:04:49.687 INFO:teuthology.orchestra.run.trial104.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.8 kB] 2026-02-13T08:04:49.687 INFO:teuthology.orchestra.run.trial119.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.8 kB] 2026-02-13T08:04:49.934 INFO:teuthology.orchestra.run.trial119.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T08:04:49.979 INFO:teuthology.orchestra.run.trial104.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T08:04:50.002 INFO:teuthology.orchestra.run.trial119.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T08:04:50.055 INFO:teuthology.orchestra.run.trial104.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T08:04:50.073 INFO:teuthology.orchestra.run.trial119.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T08:04:50.138 INFO:teuthology.orchestra.run.trial104.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T08:04:50.146 INFO:teuthology.orchestra.run.trial119.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T08:04:50.221 INFO:teuthology.orchestra.run.trial104.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T08:04:50.287 INFO:teuthology.orchestra.run.trial119.stdout:Fetched 26.5 kB in 1s (42.5 kB/s) 2026-02-13T08:04:50.365 INFO:teuthology.orchestra.run.trial104.stdout:Fetched 26.5 kB in 1s (37.4 kB/s) 2026-02-13T08:04:50.804 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-13T08:04:50.818 DEBUG:teuthology.orchestra.run.trial119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.2.0-636-g3b40640f-1jammy cephadm=20.2.0-636-g3b40640f-1jammy ceph-mds=20.2.0-636-g3b40640f-1jammy ceph-mgr=20.2.0-636-g3b40640f-1jammy ceph-common=20.2.0-636-g3b40640f-1jammy ceph-fuse=20.2.0-636-g3b40640f-1jammy ceph-test=20.2.0-636-g3b40640f-1jammy ceph-volume=20.2.0-636-g3b40640f-1jammy radosgw=20.2.0-636-g3b40640f-1jammy python3-rados=20.2.0-636-g3b40640f-1jammy python3-rgw=20.2.0-636-g3b40640f-1jammy python3-cephfs=20.2.0-636-g3b40640f-1jammy python3-rbd=20.2.0-636-g3b40640f-1jammy libcephfs2=20.2.0-636-g3b40640f-1jammy libcephfs-dev=20.2.0-636-g3b40640f-1jammy librados2=20.2.0-636-g3b40640f-1jammy librbd1=20.2.0-636-g3b40640f-1jammy rbd-fuse=20.2.0-636-g3b40640f-1jammy 2026-02-13T08:04:50.851 INFO:teuthology.orchestra.run.trial119.stdout:Reading package lists... 2026-02-13T08:04:50.892 INFO:teuthology.orchestra.run.trial104.stdout:Reading package lists... 2026-02-13T08:04:50.906 DEBUG:teuthology.orchestra.run.trial104:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.2.0-636-g3b40640f-1jammy cephadm=20.2.0-636-g3b40640f-1jammy ceph-mds=20.2.0-636-g3b40640f-1jammy ceph-mgr=20.2.0-636-g3b40640f-1jammy ceph-common=20.2.0-636-g3b40640f-1jammy ceph-fuse=20.2.0-636-g3b40640f-1jammy ceph-test=20.2.0-636-g3b40640f-1jammy ceph-volume=20.2.0-636-g3b40640f-1jammy radosgw=20.2.0-636-g3b40640f-1jammy python3-rados=20.2.0-636-g3b40640f-1jammy python3-rgw=20.2.0-636-g3b40640f-1jammy python3-cephfs=20.2.0-636-g3b40640f-1jammy python3-rbd=20.2.0-636-g3b40640f-1jammy libcephfs2=20.2.0-636-g3b40640f-1jammy libcephfs-dev=20.2.0-636-g3b40640f-1jammy librados2=20.2.0-636-g3b40640f-1jammy librbd1=20.2.0-636-g3b40640f-1jammy rbd-fuse=20.2.0-636-g3b40640f-1jammy 2026-02-13T08:04:50.939 INFO:teuthology.orchestra.run.trial104.stdout:Reading package lists... 2026-02-13T08:04:50.962 INFO:teuthology.orchestra.run.trial119.stdout:Building dependency tree... 2026-02-13T08:04:50.963 INFO:teuthology.orchestra.run.trial119.stdout:Reading state information... 2026-02-13T08:04:51.053 INFO:teuthology.orchestra.run.trial119.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T08:04:51.053 INFO:teuthology.orchestra.run.trial119.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T08:04:51.053 INFO:teuthology.orchestra.run.trial119.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T08:04:51.053 INFO:teuthology.orchestra.run.trial119.stdout: sg3-utils-udev 2026-02-13T08:04:51.053 INFO:teuthology.orchestra.run.trial119.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T08:04:51.053 INFO:teuthology.orchestra.run.trial119.stdout:The following additional packages will be installed: 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-daemon libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: liblttng-ust1 libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: python3-asyncssh python3-cachetools python3-ceph-argparse 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: python3-ceph-common python3-cheroot python3-cherrypy3 python3-google-auth 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco.functools python3-jaraco.text python3-joblib 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: python3-kubernetes python3-natsort python3-pluggy python3-portend 2026-02-13T08:04:51.054 INFO:teuthology.orchestra.run.trial119.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-13T08:04:51.055 INFO:teuthology.orchestra.run.trial119.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2026-02-13T08:04:51.055 INFO:teuthology.orchestra.run.trial119.stdout: python3-rsa python3-simplejson python3-sklearn python3-sklearn-lib 2026-02-13T08:04:51.055 INFO:teuthology.orchestra.run.trial119.stdout: python3-tempora python3-threadpoolctl python3-toml python3-wcwidth 2026-02-13T08:04:51.055 INFO:teuthology.orchestra.run.trial119.stdout: python3-webob python3-websocket python3-zc.lockfile qttranslations5-l10n 2026-02-13T08:04:51.055 INFO:teuthology.orchestra.run.trial119.stdout: socat xmlstarlet 2026-02-13T08:04:51.055 INFO:teuthology.orchestra.run.trial119.stdout:Suggested packages: 2026-02-13T08:04:51.055 INFO:teuthology.orchestra.run.trial119.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-13T08:04:51.055 INFO:teuthology.orchestra.run.trial119.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-13T08:04:51.055 INFO:teuthology.orchestra.run.trial119.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-13T08:04:51.055 INFO:teuthology.orchestra.run.trial119.stdout:Recommended packages: 2026-02-13T08:04:51.055 INFO:teuthology.orchestra.run.trial119.stdout: btrfs-tools 2026-02-13T08:04:51.056 INFO:teuthology.orchestra.run.trial104.stdout:Building dependency tree... 2026-02-13T08:04:51.056 INFO:teuthology.orchestra.run.trial104.stdout:Reading state information... 2026-02-13T08:04:51.087 INFO:teuthology.orchestra.run.trial119.stdout:The following NEW packages will be installed: 2026-02-13T08:04:51.087 INFO:teuthology.orchestra.run.trial119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-13T08:04:51.087 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-13T08:04:51.087 INFO:teuthology.orchestra.run.trial119.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-13T08:04:51.087 INFO:teuthology.orchestra.run.trial119.stdout: libcephfs-daemon libcephfs-dev libcephfs-proxy2 libcephfs2 2026-02-13T08:04:51.087 INFO:teuthology.orchestra.run.trial119.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 liboath0 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-13T08:04:51.088 INFO:teuthology.orchestra.run.trial119.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-13T08:04:51.089 INFO:teuthology.orchestra.run.trial119.stdout: socat xmlstarlet 2026-02-13T08:04:51.141 INFO:teuthology.orchestra.run.trial104.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T08:04:51.141 INFO:teuthology.orchestra.run.trial104.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T08:04:51.141 INFO:teuthology.orchestra.run.trial104.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T08:04:51.141 INFO:teuthology.orchestra.run.trial104.stdout: sg3-utils-udev 2026-02-13T08:04:51.141 INFO:teuthology.orchestra.run.trial104.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T08:04:51.141 INFO:teuthology.orchestra.run.trial104.stdout:The following additional packages will be installed: 2026-02-13T08:04:51.141 INFO:teuthology.orchestra.run.trial104.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-13T08:04:51.141 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-13T08:04:51.141 INFO:teuthology.orchestra.run.trial104.stdout: libcephfs-daemon libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 2026-02-13T08:04:51.141 INFO:teuthology.orchestra.run.trial104.stdout: liblttng-ust1 libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: python3-asyncssh python3-cachetools python3-ceph-argparse 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: python3-ceph-common python3-cheroot python3-cherrypy3 python3-google-auth 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco.functools python3-jaraco.text python3-joblib 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: python3-kubernetes python3-natsort python3-pluggy python3-portend 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: python3-rsa python3-simplejson python3-sklearn python3-sklearn-lib 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: python3-tempora python3-threadpoolctl python3-toml python3-wcwidth 2026-02-13T08:04:51.142 INFO:teuthology.orchestra.run.trial104.stdout: python3-webob python3-websocket python3-zc.lockfile qttranslations5-l10n 2026-02-13T08:04:51.143 INFO:teuthology.orchestra.run.trial104.stdout: socat xmlstarlet 2026-02-13T08:04:51.143 INFO:teuthology.orchestra.run.trial104.stdout:Suggested packages: 2026-02-13T08:04:51.143 INFO:teuthology.orchestra.run.trial104.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-13T08:04:51.143 INFO:teuthology.orchestra.run.trial104.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-13T08:04:51.143 INFO:teuthology.orchestra.run.trial104.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-13T08:04:51.143 INFO:teuthology.orchestra.run.trial104.stdout:Recommended packages: 2026-02-13T08:04:51.143 INFO:teuthology.orchestra.run.trial104.stdout: btrfs-tools 2026-02-13T08:04:51.164 INFO:teuthology.orchestra.run.trial119.stdout:0 upgraded, 86 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T08:04:51.164 INFO:teuthology.orchestra.run.trial119.stdout:Need to get 280 MB of archives. 2026-02-13T08:04:51.165 INFO:teuthology.orchestra.run.trial119.stdout:After this operation, 1119 MB of additional disk space will be used. 2026-02-13T08:04:51.165 INFO:teuthology.orchestra.run.trial119.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.2.0-636-g3b40640f-1jammy [3574 kB] 2026-02-13T08:04:51.175 INFO:teuthology.orchestra.run.trial104.stdout:The following NEW packages will be installed: 2026-02-13T08:04:51.175 INFO:teuthology.orchestra.run.trial104.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-13T08:04:51.175 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-13T08:04:51.176 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-13T08:04:51.176 INFO:teuthology.orchestra.run.trial104.stdout: libcephfs-daemon libcephfs-dev libcephfs-proxy2 libcephfs2 2026-02-13T08:04:51.176 INFO:teuthology.orchestra.run.trial104.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 liboath0 2026-02-13T08:04:51.176 INFO:teuthology.orchestra.run.trial104.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2026-02-13T08:04:51.176 INFO:teuthology.orchestra.run.trial104.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-13T08:04:51.177 INFO:teuthology.orchestra.run.trial104.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-13T08:04:51.177 INFO:teuthology.orchestra.run.trial104.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-13T08:04:51.177 INFO:teuthology.orchestra.run.trial104.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-13T08:04:51.177 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-13T08:04:51.177 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-13T08:04:51.177 INFO:teuthology.orchestra.run.trial104.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-13T08:04:51.177 INFO:teuthology.orchestra.run.trial104.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-13T08:04:51.178 INFO:teuthology.orchestra.run.trial104.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-13T08:04:51.178 INFO:teuthology.orchestra.run.trial104.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-13T08:04:51.178 INFO:teuthology.orchestra.run.trial104.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-13T08:04:51.178 INFO:teuthology.orchestra.run.trial104.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-13T08:04:51.178 INFO:teuthology.orchestra.run.trial104.stdout: socat xmlstarlet 2026-02-13T08:04:51.265 INFO:teuthology.orchestra.run.trial119.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.2.0-636-g3b40640f-1jammy [2866 kB] 2026-02-13T08:04:51.292 INFO:teuthology.orchestra.run.trial104.stdout:0 upgraded, 86 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T08:04:51.292 INFO:teuthology.orchestra.run.trial104.stdout:Need to get 280 MB of archives. 2026-02-13T08:04:51.292 INFO:teuthology.orchestra.run.trial104.stdout:After this operation, 1119 MB of additional disk space will be used. 2026-02-13T08:04:51.292 INFO:teuthology.orchestra.run.trial104.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.2.0-636-g3b40640f-1jammy [3574 kB] 2026-02-13T08:04:51.304 INFO:teuthology.orchestra.run.trial119.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.2.0-636-g3b40640f-1jammy [833 kB] 2026-02-13T08:04:51.318 INFO:teuthology.orchestra.run.trial119.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.2.0-636-g3b40640f-1jammy [364 kB] 2026-02-13T08:04:51.323 INFO:teuthology.orchestra.run.trial119.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.2.0-636-g3b40640f-1jammy [32.8 kB] 2026-02-13T08:04:51.324 INFO:teuthology.orchestra.run.trial119.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.2.0-636-g3b40640f-1jammy [184 kB] 2026-02-13T08:04:51.326 INFO:teuthology.orchestra.run.trial119.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.2.0-636-g3b40640f-1jammy [83.9 kB] 2026-02-13T08:04:51.328 INFO:teuthology.orchestra.run.trial119.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.2.0-636-g3b40640f-1jammy [340 kB] 2026-02-13T08:04:51.334 INFO:teuthology.orchestra.run.trial119.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.2.0-636-g3b40640f-1jammy [8687 kB] 2026-02-13T08:04:51.480 INFO:teuthology.orchestra.run.trial119.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.2.0-636-g3b40640f-1jammy [112 kB] 2026-02-13T08:04:51.481 INFO:teuthology.orchestra.run.trial119.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.2.0-636-g3b40640f-1jammy [261 kB] 2026-02-13T08:04:51.486 INFO:teuthology.orchestra.run.trial119.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.2.0-636-g3b40640f-1jammy [29.3 MB] 2026-02-13T08:04:51.512 INFO:teuthology.orchestra.run.trial119.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-13T08:04:51.531 INFO:teuthology.orchestra.run.trial104.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-13T08:04:51.868 INFO:teuthology.orchestra.run.trial104.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-13T08:04:51.879 INFO:teuthology.orchestra.run.trial104.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-13T08:04:51.937 INFO:teuthology.orchestra.run.trial119.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-13T08:04:51.949 INFO:teuthology.orchestra.run.trial104.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-13T08:04:51.951 INFO:teuthology.orchestra.run.trial119.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-13T08:04:51.982 INFO:teuthology.orchestra.run.trial119.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.2.0-636-g3b40640f-1jammy [5415 kB] 2026-02-13T08:04:52.040 INFO:teuthology.orchestra.run.trial119.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-13T08:04:52.070 INFO:teuthology.orchestra.run.trial119.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.2.0-636-g3b40640f-1jammy [246 kB] 2026-02-13T08:04:52.073 INFO:teuthology.orchestra.run.trial119.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.2.0-636-g3b40640f-1jammy [124 kB] 2026-02-13T08:04:52.075 INFO:teuthology.orchestra.run.trial119.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.2.0-636-g3b40640f-1jammy [906 kB] 2026-02-13T08:04:52.090 INFO:teuthology.orchestra.run.trial119.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.2.0-636-g3b40640f-1jammy [6399 kB] 2026-02-13T08:04:52.150 INFO:teuthology.orchestra.run.trial104.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-13T08:04:52.160 INFO:teuthology.orchestra.run.trial104.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-13T08:04:52.187 INFO:teuthology.orchestra.run.trial104.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-13T08:04:52.195 INFO:teuthology.orchestra.run.trial104.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-13T08:04:52.197 INFO:teuthology.orchestra.run.trial104.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-13T08:04:52.197 INFO:teuthology.orchestra.run.trial104.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-13T08:04:52.198 INFO:teuthology.orchestra.run.trial104.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-13T08:04:52.200 INFO:teuthology.orchestra.run.trial119.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.2.0-636-g3b40640f-1jammy [21.7 MB] 2026-02-13T08:04:52.215 INFO:teuthology.orchestra.run.trial104.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-13T08:04:52.216 INFO:teuthology.orchestra.run.trial104.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-13T08:04:52.222 INFO:teuthology.orchestra.run.trial104.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-13T08:04:52.288 INFO:teuthology.orchestra.run.trial104.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-13T08:04:52.289 INFO:teuthology.orchestra.run.trial104.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-13T08:04:52.289 INFO:teuthology.orchestra.run.trial104.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-13T08:04:52.289 INFO:teuthology.orchestra.run.trial104.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-13T08:04:52.289 INFO:teuthology.orchestra.run.trial104.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-13T08:04:52.290 INFO:teuthology.orchestra.run.trial104.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-13T08:04:52.290 INFO:teuthology.orchestra.run.trial104.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-13T08:04:52.293 INFO:teuthology.orchestra.run.trial119.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-13T08:04:52.294 INFO:teuthology.orchestra.run.trial104.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-13T08:04:52.295 INFO:teuthology.orchestra.run.trial104.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-13T08:04:52.308 INFO:teuthology.orchestra.run.trial119.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-13T08:04:52.340 INFO:teuthology.orchestra.run.trial119.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-13T08:04:52.351 INFO:teuthology.orchestra.run.trial119.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-13T08:04:52.353 INFO:teuthology.orchestra.run.trial119.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-13T08:04:52.354 INFO:teuthology.orchestra.run.trial119.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-13T08:04:52.355 INFO:teuthology.orchestra.run.trial119.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-13T08:04:52.364 INFO:teuthology.orchestra.run.trial104.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-13T08:04:52.366 INFO:teuthology.orchestra.run.trial104.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-13T08:04:52.366 INFO:teuthology.orchestra.run.trial104.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-13T08:04:52.367 INFO:teuthology.orchestra.run.trial104.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-13T08:04:52.376 INFO:teuthology.orchestra.run.trial119.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-13T08:04:52.378 INFO:teuthology.orchestra.run.trial119.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-13T08:04:52.385 INFO:teuthology.orchestra.run.trial119.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-13T08:04:52.392 INFO:teuthology.orchestra.run.trial104.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-13T08:04:52.394 INFO:teuthology.orchestra.run.trial104.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-13T08:04:52.394 INFO:teuthology.orchestra.run.trial104.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-13T08:04:52.452 INFO:teuthology.orchestra.run.trial104.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-13T08:04:52.452 INFO:teuthology.orchestra.run.trial104.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-13T08:04:52.452 INFO:teuthology.orchestra.run.trial104.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-13T08:04:52.453 INFO:teuthology.orchestra.run.trial104.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-13T08:04:52.453 INFO:teuthology.orchestra.run.trial104.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-13T08:04:52.454 INFO:teuthology.orchestra.run.trial104.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-13T08:04:52.469 INFO:teuthology.orchestra.run.trial119.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-13T08:04:52.470 INFO:teuthology.orchestra.run.trial119.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-13T08:04:52.470 INFO:teuthology.orchestra.run.trial119.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-13T08:04:52.470 INFO:teuthology.orchestra.run.trial119.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-13T08:04:52.470 INFO:teuthology.orchestra.run.trial119.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-13T08:04:52.471 INFO:teuthology.orchestra.run.trial119.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-13T08:04:52.471 INFO:teuthology.orchestra.run.trial119.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-13T08:04:52.476 INFO:teuthology.orchestra.run.trial119.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-13T08:04:52.477 INFO:teuthology.orchestra.run.trial119.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-13T08:04:52.513 INFO:teuthology.orchestra.run.trial104.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-13T08:04:52.514 INFO:teuthology.orchestra.run.trial104.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-13T08:04:52.515 INFO:teuthology.orchestra.run.trial104.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-13T08:04:52.565 INFO:teuthology.orchestra.run.trial119.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-13T08:04:52.567 INFO:teuthology.orchestra.run.trial119.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-13T08:04:52.568 INFO:teuthology.orchestra.run.trial119.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-13T08:04:52.569 INFO:teuthology.orchestra.run.trial119.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-13T08:04:52.574 INFO:teuthology.orchestra.run.trial119.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.2.0-636-g3b40640f-1jammy [14.1 kB] 2026-02-13T08:04:52.574 INFO:teuthology.orchestra.run.trial119.stdout:Get:47 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.2.0-636-g3b40640f-1jammy [957 kB] 2026-02-13T08:04:52.585 INFO:teuthology.orchestra.run.trial104.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-13T08:04:52.588 INFO:teuthology.orchestra.run.trial104.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-13T08:04:52.588 INFO:teuthology.orchestra.run.trial119.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.2.0-636-g3b40640f-1jammy [2345 kB] 2026-02-13T08:04:52.590 INFO:teuthology.orchestra.run.trial104.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-13T08:04:52.594 INFO:teuthology.orchestra.run.trial104.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-13T08:04:52.596 INFO:teuthology.orchestra.run.trial104.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-13T08:04:52.597 INFO:teuthology.orchestra.run.trial104.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-13T08:04:52.597 INFO:teuthology.orchestra.run.trial104.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-13T08:04:52.600 INFO:teuthology.orchestra.run.trial119.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-13T08:04:52.603 INFO:teuthology.orchestra.run.trial119.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-13T08:04:52.603 INFO:teuthology.orchestra.run.trial119.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-13T08:04:52.629 INFO:teuthology.orchestra.run.trial119.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.2.0-636-g3b40640f-1jammy [1049 kB] 2026-02-13T08:04:52.647 INFO:teuthology.orchestra.run.trial119.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.2.0-636-g3b40640f-1jammy [179 kB] 2026-02-13T08:04:52.649 INFO:teuthology.orchestra.run.trial119.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.2.0-636-g3b40640f-1jammy [45.5 MB] 2026-02-13T08:04:52.657 INFO:teuthology.orchestra.run.trial104.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-13T08:04:52.658 INFO:teuthology.orchestra.run.trial104.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-13T08:04:52.664 INFO:teuthology.orchestra.run.trial104.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-13T08:04:52.676 INFO:teuthology.orchestra.run.trial119.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-13T08:04:52.676 INFO:teuthology.orchestra.run.trial119.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-13T08:04:52.677 INFO:teuthology.orchestra.run.trial119.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-13T08:04:52.677 INFO:teuthology.orchestra.run.trial119.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-13T08:04:52.678 INFO:teuthology.orchestra.run.trial119.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-13T08:04:52.678 INFO:teuthology.orchestra.run.trial119.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-13T08:04:52.729 INFO:teuthology.orchestra.run.trial104.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-13T08:04:52.731 INFO:teuthology.orchestra.run.trial104.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-13T08:04:52.732 INFO:teuthology.orchestra.run.trial104.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-13T08:04:52.732 INFO:teuthology.orchestra.run.trial104.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-13T08:04:52.752 INFO:teuthology.orchestra.run.trial119.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-13T08:04:52.754 INFO:teuthology.orchestra.run.trial119.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-13T08:04:52.755 INFO:teuthology.orchestra.run.trial119.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-13T08:04:52.843 INFO:teuthology.orchestra.run.trial119.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-13T08:04:52.847 INFO:teuthology.orchestra.run.trial119.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-13T08:04:52.849 INFO:teuthology.orchestra.run.trial119.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-13T08:04:52.854 INFO:teuthology.orchestra.run.trial119.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-13T08:04:52.857 INFO:teuthology.orchestra.run.trial119.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-13T08:04:52.858 INFO:teuthology.orchestra.run.trial119.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-13T08:04:52.858 INFO:teuthology.orchestra.run.trial119.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-13T08:04:52.935 INFO:teuthology.orchestra.run.trial119.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-13T08:04:52.935 INFO:teuthology.orchestra.run.trial119.stdout:Get:72 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-13T08:04:52.939 INFO:teuthology.orchestra.run.trial104.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.2.0-636-g3b40640f-1jammy [2866 kB] 2026-02-13T08:04:52.943 INFO:teuthology.orchestra.run.trial119.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-13T08:04:53.026 INFO:teuthology.orchestra.run.trial119.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-13T08:04:53.028 INFO:teuthology.orchestra.run.trial119.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-13T08:04:53.029 INFO:teuthology.orchestra.run.trial119.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-13T08:04:53.029 INFO:teuthology.orchestra.run.trial119.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-13T08:04:53.463 INFO:teuthology.orchestra.run.trial119.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.2.0-636-g3b40640f-1jammy [8625 kB] 2026-02-13T08:04:53.480 INFO:teuthology.orchestra.run.trial104.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.2.0-636-g3b40640f-1jammy [833 kB] 2026-02-13T08:04:53.595 INFO:teuthology.orchestra.run.trial104.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.2.0-636-g3b40640f-1jammy [364 kB] 2026-02-13T08:04:53.617 INFO:teuthology.orchestra.run.trial119.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.2.0-636-g3b40640f-1jammy [14.2 kB] 2026-02-13T08:04:53.618 INFO:teuthology.orchestra.run.trial119.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.2.0-636-g3b40640f-1jammy [99.4 MB] 2026-02-13T08:04:53.650 INFO:teuthology.orchestra.run.trial104.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.2.0-636-g3b40640f-1jammy [32.8 kB] 2026-02-13T08:04:53.650 INFO:teuthology.orchestra.run.trial104.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.2.0-636-g3b40640f-1jammy [184 kB] 2026-02-13T08:04:53.653 INFO:teuthology.orchestra.run.trial104.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.2.0-636-g3b40640f-1jammy [83.9 kB] 2026-02-13T08:04:53.655 INFO:teuthology.orchestra.run.trial104.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.2.0-636-g3b40640f-1jammy [340 kB] 2026-02-13T08:04:53.711 INFO:teuthology.orchestra.run.trial104.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.2.0-636-g3b40640f-1jammy [8687 kB] 2026-02-13T08:04:54.545 INFO:teuthology.orchestra.run.trial104.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.2.0-636-g3b40640f-1jammy [112 kB] 2026-02-13T08:04:54.545 INFO:teuthology.orchestra.run.trial104.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.2.0-636-g3b40640f-1jammy [261 kB] 2026-02-13T08:04:54.549 INFO:teuthology.orchestra.run.trial104.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.2.0-636-g3b40640f-1jammy [29.3 MB] 2026-02-13T08:04:55.856 INFO:teuthology.orchestra.run.trial104.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.2.0-636-g3b40640f-1jammy [5415 kB] 2026-02-13T08:04:55.927 INFO:teuthology.orchestra.run.trial119.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.2.0-636-g3b40640f-1jammy [135 kB] 2026-02-13T08:04:55.928 INFO:teuthology.orchestra.run.trial119.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.2.0-636-g3b40640f-1jammy [43.2 kB] 2026-02-13T08:04:55.929 INFO:teuthology.orchestra.run.trial119.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.2.0-636-g3b40640f-1jammy [30.7 kB] 2026-02-13T08:04:55.929 INFO:teuthology.orchestra.run.trial119.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.2.0-636-g3b40640f-1jammy [41.5 kB] 2026-02-13T08:04:55.929 INFO:teuthology.orchestra.run.trial119.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.2.0-636-g3b40640f-1jammy [25.1 MB] 2026-02-13T08:04:56.040 INFO:teuthology.orchestra.run.trial104.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.2.0-636-g3b40640f-1jammy [246 kB] 2026-02-13T08:04:56.044 INFO:teuthology.orchestra.run.trial104.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.2.0-636-g3b40640f-1jammy [124 kB] 2026-02-13T08:04:56.062 INFO:teuthology.orchestra.run.trial104.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.2.0-636-g3b40640f-1jammy [906 kB] 2026-02-13T08:04:56.088 INFO:teuthology.orchestra.run.trial104.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.2.0-636-g3b40640f-1jammy [6399 kB] 2026-02-13T08:04:56.322 INFO:teuthology.orchestra.run.trial104.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.2.0-636-g3b40640f-1jammy [21.7 MB] 2026-02-13T08:04:56.691 INFO:teuthology.orchestra.run.trial119.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.2.0-636-g3b40640f-1jammy [97.5 kB] 2026-02-13T08:04:56.874 INFO:teuthology.orchestra.run.trial104.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.2.0-636-g3b40640f-1jammy [14.1 kB] 2026-02-13T08:04:56.875 INFO:teuthology.orchestra.run.trial104.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.2.0-636-g3b40640f-1jammy [957 kB] 2026-02-13T08:04:56.887 INFO:teuthology.orchestra.run.trial104.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.2.0-636-g3b40640f-1jammy [2345 kB] 2026-02-13T08:04:56.925 INFO:teuthology.orchestra.run.trial104.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.2.0-636-g3b40640f-1jammy [1049 kB] 2026-02-13T08:04:56.942 INFO:teuthology.orchestra.run.trial104.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.2.0-636-g3b40640f-1jammy [179 kB] 2026-02-13T08:04:56.945 INFO:teuthology.orchestra.run.trial104.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.2.0-636-g3b40640f-1jammy [45.5 MB] 2026-02-13T08:04:56.964 INFO:teuthology.orchestra.run.trial119.stdout:Fetched 280 MB in 6s (50.0 MB/s) 2026-02-13T08:04:56.981 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-13T08:04:57.136 INFO:teuthology.orchestra.run.trial119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-13T08:04:57.138 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-13T08:04:57.139 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T08:04:57.159 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-13T08:04:57.172 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-13T08:04:57.172 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T08:04:57.189 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-13T08:04:57.197 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-13T08:04:57.198 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T08:04:57.216 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-13T08:04:57.228 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T08:04:57.233 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:04:57.265 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-13T08:04:57.273 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T08:04:57.274 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:04:57.290 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-13T08:04:57.298 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T08:04:57.298 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:04:57.320 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-13T08:04:57.328 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-13T08:04:57.329 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T08:04:57.345 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librados2. 2026-02-13T08:04:57.353 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../07-librados2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:57.353 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librados2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:57.393 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libnbd0. 2026-02-13T08:04:57.402 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-13T08:04:57.402 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-13T08:04:57.416 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librbd1. 2026-02-13T08:04:57.424 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../09-librbd1_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:57.425 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librbd1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:57.462 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libcephfs2. 2026-02-13T08:04:57.470 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../10-libcephfs2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:57.470 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libcephfs2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:57.490 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rados. 2026-02-13T08:04:57.498 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../11-python3-rados_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:57.499 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rados (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:57.516 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-13T08:04:57.524 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:04:57.524 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-ceph-argparse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:57.538 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cephfs. 2026-02-13T08:04:57.546 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../13-python3-cephfs_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:57.546 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cephfs (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:57.562 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-13T08:04:57.570 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../14-python3-ceph-common_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:04:57.570 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:57.588 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-13T08:04:57.596 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-13T08:04:57.597 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T08:04:57.612 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-prettytable. 2026-02-13T08:04:57.621 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-13T08:04:57.621 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-13T08:04:57.636 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rbd. 2026-02-13T08:04:57.644 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../17-python3-rbd_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:57.644 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rbd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:57.661 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-13T08:04:57.669 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-13T08:04:57.669 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T08:04:57.688 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package librgw2. 2026-02-13T08:04:57.696 INFO:teuthology.orchestra.run.trial104.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.2.0-636-g3b40640f-1jammy [8625 kB] 2026-02-13T08:04:57.697 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../19-librgw2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:57.697 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking librgw2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:57.794 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rgw. 2026-02-13T08:04:57.802 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../20-python3-rgw_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:57.803 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:57.817 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-13T08:04:57.825 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-13T08:04:57.825 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T08:04:57.831 INFO:teuthology.orchestra.run.trial104.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.2.0-636-g3b40640f-1jammy [14.2 kB] 2026-02-13T08:04:57.832 INFO:teuthology.orchestra.run.trial104.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.2.0-636-g3b40640f-1jammy [99.4 MB] 2026-02-13T08:04:57.839 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libradosstriper1. 2026-02-13T08:04:57.848 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../22-libradosstriper1_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:57.848 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libradosstriper1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:57.864 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-common. 2026-02-13T08:04:57.872 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../23-ceph-common_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:57.872 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.118 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-base. 2026-02-13T08:04:58.127 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../24-ceph-base_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:58.132 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-base (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.195 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-13T08:04:58.203 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-13T08:04:58.204 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-13T08:04:58.218 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cheroot. 2026-02-13T08:04:58.226 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-13T08:04:58.227 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T08:04:58.243 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-13T08:04:58.251 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-13T08:04:58.252 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-13T08:04:58.266 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-13T08:04:58.274 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-13T08:04:58.275 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-13T08:04:58.288 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-13T08:04:58.297 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-13T08:04:58.297 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-13T08:04:58.311 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-tempora. 2026-02-13T08:04:58.319 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-13T08:04:58.320 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-13T08:04:58.333 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-portend. 2026-02-13T08:04:58.342 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-13T08:04:58.342 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-13T08:04:58.356 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-13T08:04:58.364 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-13T08:04:58.365 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-13T08:04:58.379 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-13T08:04:58.387 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-13T08:04:58.388 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-13T08:04:58.412 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-natsort. 2026-02-13T08:04:58.420 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-13T08:04:58.420 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-13T08:04:58.436 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-13T08:04:58.444 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:04:58.445 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-modules-core (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.470 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-13T08:04:58.478 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:58.479 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libsqlite3-mod-ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.494 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr. 2026-02-13T08:04:58.502 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../37-ceph-mgr_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:58.502 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.523 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mon. 2026-02-13T08:04:58.531 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../38-ceph-mon_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:58.531 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.589 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-13T08:04:58.598 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-13T08:04:58.598 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T08:04:58.613 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-osd. 2026-02-13T08:04:58.622 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../40-ceph-osd_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:58.622 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-osd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.766 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph. 2026-02-13T08:04:58.774 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../41-ceph_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:58.775 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.789 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-fuse. 2026-02-13T08:04:58.797 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../42-ceph-fuse_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:58.798 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.819 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mds. 2026-02-13T08:04:58.827 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../43-ceph-mds_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:58.828 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mds (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.865 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package cephadm. 2026-02-13T08:04:58.874 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../44-cephadm_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:04:58.874 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.890 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-13T08:04:58.898 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../45-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T08:04:58.899 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T08:04:58.920 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-13T08:04:58.928 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../46-ceph-mgr-cephadm_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:04:58.929 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:58.950 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-13T08:04:58.958 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../47-python3-repoze.lru_0.7-2_all.deb ... 2026-02-13T08:04:58.959 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-13T08:04:58.973 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-routes. 2026-02-13T08:04:58.981 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../48-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-13T08:04:58.981 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T08:04:59.001 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-13T08:04:59.009 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../49-ceph-mgr-dashboard_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:04:59.010 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-dashboard (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:59.435 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-13T08:04:59.444 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../50-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-13T08:04:59.445 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T08:04:59.473 INFO:teuthology.orchestra.run.trial104.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.2.0-636-g3b40640f-1jammy [135 kB] 2026-02-13T08:04:59.474 INFO:teuthology.orchestra.run.trial104.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.2.0-636-g3b40640f-1jammy [43.2 kB] 2026-02-13T08:04:59.474 INFO:teuthology.orchestra.run.trial104.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.2.0-636-g3b40640f-1jammy [30.7 kB] 2026-02-13T08:04:59.475 INFO:teuthology.orchestra.run.trial104.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.2.0-636-g3b40640f-1jammy [41.5 kB] 2026-02-13T08:04:59.475 INFO:teuthology.orchestra.run.trial104.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.2.0-636-g3b40640f-1jammy [25.1 MB] 2026-02-13T08:04:59.483 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-joblib. 2026-02-13T08:04:59.492 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../51-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-13T08:04:59.492 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T08:04:59.519 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-13T08:04:59.527 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../52-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-13T08:04:59.527 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-13T08:04:59.543 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-sklearn. 2026-02-13T08:04:59.552 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../53-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-13T08:04:59.552 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T08:04:59.635 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-13T08:04:59.643 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../54-ceph-mgr-diskprediction-local_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:04:59.643 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-diskprediction-local (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:04:59.799 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-cachetools. 2026-02-13T08:04:59.807 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../55-python3-cachetools_5.0.0-1_all.deb ... 2026-02-13T08:04:59.808 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-13T08:04:59.822 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-rsa. 2026-02-13T08:04:59.831 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../56-python3-rsa_4.8-1_all.deb ... 2026-02-13T08:04:59.831 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-13T08:04:59.849 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-google-auth. 2026-02-13T08:04:59.858 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../57-python3-google-auth_1.5.1-3_all.deb ... 2026-02-13T08:04:59.858 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-13T08:04:59.875 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-13T08:04:59.876 INFO:teuthology.orchestra.run.trial104.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.2.0-636-g3b40640f-1jammy [97.5 kB] 2026-02-13T08:04:59.883 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../58-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-13T08:04:59.884 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T08:04:59.900 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-websocket. 2026-02-13T08:04:59.909 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../59-python3-websocket_1.2.3-1_all.deb ... 2026-02-13T08:04:59.909 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-13T08:04:59.927 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-13T08:04:59.935 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../60-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-13T08:04:59.936 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T08:05:00.030 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-13T08:05:00.038 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../61-ceph-mgr-k8sevents_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:05:00.039 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-mgr-k8sevents (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:00.053 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-13T08:05:00.061 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../62-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-13T08:05:00.061 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T08:05:00.077 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-13T08:05:00.086 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../63-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T08:05:00.086 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T08:05:00.101 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package jq. 2026-02-13T08:05:00.109 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../64-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T08:05:00.110 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-13T08:05:00.123 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package socat. 2026-02-13T08:05:00.132 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../65-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-13T08:05:00.133 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-13T08:05:00.153 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package xmlstarlet. 2026-02-13T08:05:00.153 INFO:teuthology.orchestra.run.trial104.stdout:Fetched 280 MB in 9s (32.2 MB/s) 2026-02-13T08:05:00.161 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../66-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-13T08:05:00.161 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-13T08:05:00.171 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-13T08:05:00.198 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-test. 2026-02-13T08:05:00.206 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../67-ceph-test_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:00.207 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-test (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:00.330 INFO:teuthology.orchestra.run.trial104.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-13T08:05:00.332 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-13T08:05:00.333 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T08:05:00.354 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-13T08:05:00.367 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-13T08:05:00.367 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T08:05:00.384 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-13T08:05:00.396 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-13T08:05:00.396 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T08:05:00.416 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-13T08:05:00.424 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T08:05:00.429 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:05:00.464 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-13T08:05:00.474 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T08:05:00.474 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:05:00.491 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-13T08:05:00.499 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T08:05:00.500 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:05:00.519 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-13T08:05:00.527 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-13T08:05:00.528 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T08:05:00.544 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package librados2. 2026-02-13T08:05:00.552 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../07-librados2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:00.552 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking librados2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:00.594 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libnbd0. 2026-02-13T08:05:00.602 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-13T08:05:00.603 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-13T08:05:00.617 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package librbd1. 2026-02-13T08:05:00.625 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../09-librbd1_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:00.626 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking librbd1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:00.664 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libcephfs2. 2026-02-13T08:05:00.672 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../10-libcephfs2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:00.672 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libcephfs2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:00.692 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-rados. 2026-02-13T08:05:00.700 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../11-python3-rados_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:00.701 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-rados (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:00.717 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-13T08:05:00.726 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:05:00.726 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-ceph-argparse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:00.740 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-cephfs. 2026-02-13T08:05:00.748 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../13-python3-cephfs_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:00.748 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-cephfs (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:00.764 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-13T08:05:00.772 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../14-python3-ceph-common_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:05:00.772 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:00.791 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-13T08:05:00.799 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-13T08:05:00.800 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T08:05:00.815 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-prettytable. 2026-02-13T08:05:00.823 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-13T08:05:00.824 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-13T08:05:00.837 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-rbd. 2026-02-13T08:05:00.846 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../17-python3-rbd_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:00.846 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-rbd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:00.863 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-13T08:05:00.871 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-13T08:05:00.871 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T08:05:00.890 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package librgw2. 2026-02-13T08:05:00.898 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../19-librgw2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:00.898 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking librgw2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:00.997 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-rgw. 2026-02-13T08:05:01.005 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../20-python3-rgw_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.006 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-rgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.021 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-13T08:05:01.029 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-13T08:05:01.029 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T08:05:01.044 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libradosstriper1. 2026-02-13T08:05:01.052 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../22-libradosstriper1_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.053 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libradosstriper1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.070 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-common. 2026-02-13T08:05:01.078 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../23-ceph-common_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.078 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.089 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package ceph-volume. 2026-02-13T08:05:01.098 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../68-ceph-volume_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:05:01.098 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking ceph-volume (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.121 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-13T08:05:01.130 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../69-libcephfs-daemon_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.130 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libcephfs-daemon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.145 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-13T08:05:01.153 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../70-libcephfs-proxy2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.154 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libcephfs-proxy2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.168 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-13T08:05:01.177 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../71-libcephfs-dev_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.178 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking libcephfs-dev (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.193 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package nvme-cli. 2026-02-13T08:05:01.201 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../72-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-13T08:05:01.202 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T08:05:01.233 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-13T08:05:01.241 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../73-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T08:05:01.242 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T08:05:01.270 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-13T08:05:01.279 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../74-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-13T08:05:01.279 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-13T08:05:01.293 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pluggy. 2026-02-13T08:05:01.301 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../75-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-13T08:05:01.301 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-13T08:05:01.317 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-psutil. 2026-02-13T08:05:01.324 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-base. 2026-02-13T08:05:01.326 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../76-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-13T08:05:01.326 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-13T08:05:01.333 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../24-ceph-base_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.338 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-base (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.344 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-py. 2026-02-13T08:05:01.352 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../77-python3-py_1.10.0-1_all.deb ... 2026-02-13T08:05:01.353 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-13T08:05:01.373 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pygments. 2026-02-13T08:05:01.380 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../78-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-13T08:05:01.381 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T08:05:01.404 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-13T08:05:01.413 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-13T08:05:01.413 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-13T08:05:01.423 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-toml. 2026-02-13T08:05:01.428 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-cheroot. 2026-02-13T08:05:01.431 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../79-python3-toml_0.10.2-1_all.deb ... 2026-02-13T08:05:01.432 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-13T08:05:01.437 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-13T08:05:01.437 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T08:05:01.447 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-pytest. 2026-02-13T08:05:01.454 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-13T08:05:01.455 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../80-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-13T08:05:01.455 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T08:05:01.462 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-13T08:05:01.463 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-13T08:05:01.476 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-simplejson. 2026-02-13T08:05:01.478 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-13T08:05:01.485 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../81-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-13T08:05:01.486 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-13T08:05:01.486 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-13T08:05:01.487 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-13T08:05:01.501 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-13T08:05:01.503 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package python3-webob. 2026-02-13T08:05:01.509 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-13T08:05:01.509 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-13T08:05:01.511 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../82-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-13T08:05:01.511 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T08:05:01.524 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-tempora. 2026-02-13T08:05:01.532 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-13T08:05:01.533 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-13T08:05:01.535 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-13T08:05:01.543 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../83-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-13T08:05:01.544 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-13T08:05:01.546 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-portend. 2026-02-13T08:05:01.554 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-13T08:05:01.555 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-13T08:05:01.569 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-13T08:05:01.577 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-13T08:05:01.578 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-13T08:05:01.593 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-13T08:05:01.601 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-13T08:05:01.601 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-13T08:05:01.609 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package radosgw. 2026-02-13T08:05:01.618 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../84-radosgw_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.618 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking radosgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.625 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-natsort. 2026-02-13T08:05:01.633 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-13T08:05:01.633 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-13T08:05:01.649 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-13T08:05:01.657 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:05:01.658 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-mgr-modules-core (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.684 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-13T08:05:01.693 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.693 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libsqlite3-mod-ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.708 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-mgr. 2026-02-13T08:05:01.716 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../37-ceph-mgr_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.717 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-mgr (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.737 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-mon. 2026-02-13T08:05:01.746 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../38-ceph-mon_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.746 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-mon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.803 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-13T08:05:01.812 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-13T08:05:01.812 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T08:05:01.825 INFO:teuthology.orchestra.run.trial119.stdout:Selecting previously unselected package rbd-fuse. 2026-02-13T08:05:01.828 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-osd. 2026-02-13T08:05:01.834 INFO:teuthology.orchestra.run.trial119.stdout:Preparing to unpack .../85-rbd-fuse_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.834 INFO:teuthology.orchestra.run.trial119.stdout:Unpacking rbd-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.836 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../40-ceph-osd_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.836 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-osd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:01.861 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-13T08:05:01.928 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T08:05:01.928 INFO:teuthology.orchestra.run.trial119.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T08:05:01.981 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph. 2026-02-13T08:05:01.990 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../41-ceph_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:01.990 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:02.002 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T08:05:02.004 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-fuse. 2026-02-13T08:05:02.011 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../42-ceph-fuse_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:02.012 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:02.033 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-mds. 2026-02-13T08:05:02.042 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../43-ceph-mds_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:02.042 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-mds (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:02.073 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package cephadm. 2026-02-13T08:05:02.081 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../44-cephadm_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:02.082 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:02.098 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-13T08:05:02.106 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../45-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T08:05:02.106 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T08:05:02.128 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-13T08:05:02.136 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../46-ceph-mgr-cephadm_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:05:02.136 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-mgr-cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:02.156 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-13T08:05:02.165 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../47-python3-repoze.lru_0.7-2_all.deb ... 2026-02-13T08:05:02.165 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-13T08:05:02.179 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-routes. 2026-02-13T08:05:02.188 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../48-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-13T08:05:02.188 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T08:05:02.208 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-13T08:05:02.216 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../49-ceph-mgr-dashboard_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:05:02.217 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-mgr-dashboard (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:02.277 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-13T08:05:02.644 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-13T08:05:02.653 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../50-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-13T08:05:02.653 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T08:05:02.662 INFO:teuthology.orchestra.run.trial119.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-13T08:05:02.673 INFO:teuthology.orchestra.run.trial119.stdout:Setting up cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:02.691 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-joblib. 2026-02-13T08:05:02.699 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../51-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-13T08:05:02.700 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T08:05:02.715 INFO:teuthology.orchestra.run.trial119.stdout:Adding system user cephadm....done 2026-02-13T08:05:02.724 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-13T08:05:02.728 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-13T08:05:02.737 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../52-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-13T08:05:02.738 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-13T08:05:02.752 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-sklearn. 2026-02-13T08:05:02.761 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../53-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-13T08:05:02.761 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T08:05:02.796 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T08:05:02.797 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-13T08:05:02.843 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-13T08:05:02.852 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../54-ceph-mgr-diskprediction-local_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:05:02.853 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-mgr-diskprediction-local (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:02.869 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-13T08:05:02.943 INFO:teuthology.orchestra.run.trial119.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T08:05:02.944 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-13T08:05:03.015 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-cachetools. 2026-02-13T08:05:03.023 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../55-python3-cachetools_5.0.0-1_all.deb ... 2026-02-13T08:05:03.024 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-13T08:05:03.038 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-rsa. 2026-02-13T08:05:03.038 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T08:05:03.046 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../56-python3-rsa_4.8-1_all.deb ... 2026-02-13T08:05:03.047 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-13T08:05:03.065 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-google-auth. 2026-02-13T08:05:03.074 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../57-python3-google-auth_1.5.1-3_all.deb ... 2026-02-13T08:05:03.074 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-13T08:05:03.092 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-13T08:05:03.100 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../58-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-13T08:05:03.100 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T08:05:03.116 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-websocket. 2026-02-13T08:05:03.125 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../59-python3-websocket_1.2.3-1_all.deb ... 2026-02-13T08:05:03.125 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-13T08:05:03.142 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-13T08:05:03.150 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../60-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-13T08:05:03.150 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T08:05:03.159 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-13T08:05:03.235 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-13T08:05:03.243 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-13T08:05:03.252 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../61-ceph-mgr-k8sevents_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:05:03.253 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-mgr-k8sevents (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:03.267 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-13T08:05:03.275 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../62-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-13T08:05:03.276 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T08:05:03.291 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-13T08:05:03.300 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../63-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T08:05:03.301 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T08:05:03.310 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-ceph-argparse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:03.315 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package jq. 2026-02-13T08:05:03.324 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../64-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T08:05:03.324 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-13T08:05:03.338 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package socat. 2026-02-13T08:05:03.347 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../65-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-13T08:05:03.347 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-13T08:05:03.367 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package xmlstarlet. 2026-02-13T08:05:03.375 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T08:05:03.376 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../66-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-13T08:05:03.376 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-13T08:05:03.376 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-13T08:05:03.377 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T08:05:03.378 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T08:05:03.379 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-13T08:05:03.411 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-test. 2026-02-13T08:05:03.419 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../67-ceph-test_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:03.420 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-test (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:03.497 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-13T08:05:03.573 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libcephfs-proxy2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:03.574 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T08:05:03.654 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-13T08:05:03.742 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T08:05:03.983 INFO:teuthology.orchestra.run.trial119.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-13T08:05:03.984 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T08:05:04.077 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T08:05:04.199 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T08:05:04.281 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-13T08:05:04.316 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package ceph-volume. 2026-02-13T08:05:04.324 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../68-ceph-volume_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T08:05:04.325 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking ceph-volume (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:04.347 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-13T08:05:04.352 INFO:teuthology.orchestra.run.trial119.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-13T08:05:04.354 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:04.355 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../69-libcephfs-daemon_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:04.356 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libcephfs-daemon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:04.370 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-13T08:05:04.379 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../70-libcephfs-proxy2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:04.379 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libcephfs-proxy2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:04.393 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-13T08:05:04.402 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../71-libcephfs-dev_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:04.402 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking libcephfs-dev (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:04.418 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package nvme-cli. 2026-02-13T08:05:04.426 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../72-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-13T08:05:04.427 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T08:05:04.440 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T08:05:04.457 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-13T08:05:04.465 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../73-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T08:05:04.465 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T08:05:04.495 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-13T08:05:04.504 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../74-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-13T08:05:04.504 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-13T08:05:04.519 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-pluggy. 2026-02-13T08:05:04.527 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../75-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-13T08:05:04.528 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-13T08:05:04.543 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-psutil. 2026-02-13T08:05:04.552 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../76-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-13T08:05:04.552 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-13T08:05:04.571 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-py. 2026-02-13T08:05:04.580 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../77-python3-py_1.10.0-1_all.deb ... 2026-02-13T08:05:04.580 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-13T08:05:04.601 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-pygments. 2026-02-13T08:05:04.609 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../78-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-13T08:05:04.610 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T08:05:04.650 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-toml. 2026-02-13T08:05:04.659 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../79-python3-toml_0.10.2-1_all.deb ... 2026-02-13T08:05:04.659 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-13T08:05:04.675 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-pytest. 2026-02-13T08:05:04.683 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../80-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-13T08:05:04.684 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T08:05:04.706 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-simplejson. 2026-02-13T08:05:04.715 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../81-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-13T08:05:04.715 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-13T08:05:04.733 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package python3-webob. 2026-02-13T08:05:04.741 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../82-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-13T08:05:04.742 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T08:05:04.765 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-13T08:05:04.774 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../83-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-13T08:05:04.774 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-13T08:05:04.841 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package radosgw. 2026-02-13T08:05:04.850 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../84-radosgw_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:04.850 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking radosgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:04.947 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:05:04.952 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-13T08:05:05.031 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T08:05:05.032 INFO:teuthology.orchestra.run.trial119.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-13T08:05:05.033 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-13T08:05:05.061 INFO:teuthology.orchestra.run.trial104.stdout:Selecting previously unselected package rbd-fuse. 2026-02-13T08:05:05.070 INFO:teuthology.orchestra.run.trial104.stdout:Preparing to unpack .../85-rbd-fuse_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T08:05:05.070 INFO:teuthology.orchestra.run.trial104.stdout:Unpacking rbd-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:05.098 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-13T08:05:05.107 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-13T08:05:05.165 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T08:05:05.166 INFO:teuthology.orchestra.run.trial104.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T08:05:05.180 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:05:05.181 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-13T08:05:05.237 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T08:05:05.257 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-13T08:05:05.330 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-13T08:05:05.409 INFO:teuthology.orchestra.run.trial119.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T08:05:05.410 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-13T08:05:05.491 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T08:05:05.492 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T08:05:05.504 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-13T08:05:05.570 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T08:05:05.654 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-13T08:05:05.726 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T08:05:05.727 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T08:05:05.858 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-13T08:05:05.863 INFO:teuthology.orchestra.run.trial104.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-13T08:05:05.873 INFO:teuthology.orchestra.run.trial104.stdout:Setting up cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:05.915 INFO:teuthology.orchestra.run.trial104.stdout:Adding system user cephadm....done 2026-02-13T08:05:05.926 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-13T08:05:05.929 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:05:05.930 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-13T08:05:05.998 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T08:05:05.999 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-13T08:05:06.013 INFO:teuthology.orchestra.run.trial119.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-13T08:05:06.014 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-13T08:05:06.071 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-13T08:05:06.142 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T08:05:06.143 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librados2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:06.144 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librgw2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:06.145 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libsqlite3-mod-ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:06.145 INFO:teuthology.orchestra.run.trial104.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T08:05:06.146 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T08:05:06.147 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-13T08:05:06.241 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T08:05:06.366 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-13T08:05:06.445 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-13T08:05:06.517 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-ceph-argparse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:06.584 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T08:05:06.585 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-13T08:05:06.587 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T08:05:06.587 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T08:05:06.588 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-13T08:05:06.662 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libcephfs2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:06.663 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libradosstriper1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:06.664 INFO:teuthology.orchestra.run.trial119.stdout:Setting up librbd1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:06.665 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-modules-core (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:06.666 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:06.709 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-13T08:05:06.739 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T08:05:06.740 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T08:05:06.788 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libcephfs-proxy2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:06.789 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T08:05:06.868 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-13T08:05:06.955 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T08:05:07.142 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libcephfs-dev (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:07.143 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rados (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:07.144 INFO:teuthology.orchestra.run.trial119.stdout:Setting up libcephfs-daemon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:07.144 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rbd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:07.145 INFO:teuthology.orchestra.run.trial119.stdout:Setting up rbd-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:07.146 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-rgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:07.147 INFO:teuthology.orchestra.run.trial119.stdout:Setting up python3-cephfs (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:07.148 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:07.176 INFO:teuthology.orchestra.run.trial119.stdout:Adding group ceph....done 2026-02-13T08:05:07.208 INFO:teuthology.orchestra.run.trial104.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-13T08:05:07.209 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T08:05:07.211 INFO:teuthology.orchestra.run.trial119.stdout:Adding system user ceph....done 2026-02-13T08:05:07.220 INFO:teuthology.orchestra.run.trial119.stdout:Setting system user ceph properties....done 2026-02-13T08:05:07.227 INFO:teuthology.orchestra.run.trial119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-13T08:05:07.302 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T08:05:07.315 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-13T08:05:07.428 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T08:05:07.508 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-13T08:05:07.579 INFO:teuthology.orchestra.run.trial104.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-13T08:05:07.580 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:07.588 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-13T08:05:07.671 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T08:05:07.967 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-test (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:07.968 INFO:teuthology.orchestra.run.trial119.stdout:Setting up radosgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:08.185 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:05:08.190 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-13T08:05:08.226 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T08:05:08.226 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T08:05:08.270 INFO:teuthology.orchestra.run.trial104.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T08:05:08.271 INFO:teuthology.orchestra.run.trial104.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-13T08:05:08.272 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-13T08:05:08.345 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-13T08:05:08.419 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:05:08.420 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-13T08:05:08.496 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-13T08:05:08.568 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-13T08:05:08.602 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-base (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:08.638 INFO:teuthology.orchestra.run.trial104.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T08:05:08.639 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-13T08:05:08.716 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-13T08:05:08.722 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T08:05:08.723 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T08:05:08.799 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T08:05:08.882 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-13T08:05:08.956 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T08:05:08.957 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T08:05:09.089 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-13T08:05:09.103 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mds (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:09.163 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T08:05:09.163 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T08:05:09.166 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T08:05:09.167 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-13T08:05:09.250 INFO:teuthology.orchestra.run.trial104.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-13T08:05:09.251 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-13T08:05:09.389 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T08:05:09.390 INFO:teuthology.orchestra.run.trial104.stdout:Setting up librados2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:09.391 INFO:teuthology.orchestra.run.trial104.stdout:Setting up librgw2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:09.392 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libsqlite3-mod-ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:09.393 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T08:05:09.546 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:09.619 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T08:05:09.620 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T08:05:09.920 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libcephfs2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:09.921 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libradosstriper1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:09.922 INFO:teuthology.orchestra.run.trial104.stdout:Setting up librbd1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:09.923 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-mgr-modules-core (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:09.924 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:09.991 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-osd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:09.995 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T08:05:09.995 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T08:05:10.063 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T08:05:10.064 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T08:05:10.373 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libcephfs-dev (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.374 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-rados (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.374 INFO:teuthology.orchestra.run.trial104.stdout:Setting up libcephfs-daemon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.375 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-rbd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.376 INFO:teuthology.orchestra.run.trial104.stdout:Setting up rbd-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.377 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-rgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.378 INFO:teuthology.orchestra.run.trial104.stdout:Setting up python3-cephfs (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.379 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.406 INFO:teuthology.orchestra.run.trial104.stdout:Adding group ceph....done 2026-02-13T08:05:10.414 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-k8sevents (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.423 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-diskprediction-local (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.433 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.441 INFO:teuthology.orchestra.run.trial104.stdout:Adding system user ceph....done 2026-02-13T08:05:10.451 INFO:teuthology.orchestra.run.trial104.stdout:Setting system user ceph properties....done 2026-02-13T08:05:10.457 INFO:teuthology.orchestra.run.trial104.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-13T08:05:10.501 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T08:05:10.502 INFO:teuthology.orchestra.run.trial119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T08:05:10.545 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-13T08:05:10.807 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-13T08:05:10.893 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.903 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.904 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-mgr-dashboard (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:10.915 INFO:teuthology.orchestra.run.trial119.stdout:Setting up ceph-volume (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:11.019 INFO:teuthology.orchestra.run.trial119.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-13T08:05:11.102 INFO:teuthology.orchestra.run.trial119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-13T08:05:11.165 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-test (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:11.166 INFO:teuthology.orchestra.run.trial104.stdout:Setting up radosgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:11.406 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T08:05:11.406 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T08:05:11.531 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:11.531 INFO:teuthology.orchestra.run.trial119.stdout:Running kernel seems to be up-to-date. 2026-02-13T08:05:11.531 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:11.531 INFO:teuthology.orchestra.run.trial119.stdout:The processor microcode seems to be up-to-date. 2026-02-13T08:05:11.531 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:11.531 INFO:teuthology.orchestra.run.trial119.stdout:No services need to be restarted. 2026-02-13T08:05:11.531 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:11.531 INFO:teuthology.orchestra.run.trial119.stdout:No containers need to be restarted. 2026-02-13T08:05:11.531 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:11.532 INFO:teuthology.orchestra.run.trial119.stdout:No user sessions are running outdated binaries. 2026-02-13T08:05:11.532 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:11.532 INFO:teuthology.orchestra.run.trial119.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T08:05:11.747 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-base (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:11.864 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-13T08:05:12.149 INFO:teuthology.orchestra.run.trial119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-13T08:05:12.155 DEBUG:teuthology.parallel:result is None 2026-02-13T08:05:12.202 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-mds (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:12.264 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T08:05:12.264 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T08:05:12.624 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-mgr (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:12.704 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T08:05:12.704 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T08:05:13.079 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-osd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:13.177 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T08:05:13.177 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T08:05:13.535 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-mgr-k8sevents (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:13.544 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-mgr-diskprediction-local (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:13.555 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-mon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:13.624 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T08:05:13.624 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T08:05:13.996 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-mgr-cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:14.008 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:14.009 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-mgr-dashboard (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:14.021 INFO:teuthology.orchestra.run.trial104.stdout:Setting up ceph-volume (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T08:05:14.131 INFO:teuthology.orchestra.run.trial104.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-13T08:05:14.218 INFO:teuthology.orchestra.run.trial104.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-13T08:05:14.664 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:14.664 INFO:teuthology.orchestra.run.trial104.stdout:Running kernel seems to be up-to-date. 2026-02-13T08:05:14.664 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:14.664 INFO:teuthology.orchestra.run.trial104.stdout:The processor microcode seems to be up-to-date. 2026-02-13T08:05:14.664 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:14.664 INFO:teuthology.orchestra.run.trial104.stdout:No services need to be restarted. 2026-02-13T08:05:14.664 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:14.664 INFO:teuthology.orchestra.run.trial104.stdout:No containers need to be restarted. 2026-02-13T08:05:14.665 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:14.665 INFO:teuthology.orchestra.run.trial104.stdout:No user sessions are running outdated binaries. 2026-02-13T08:05:14.665 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:14.665 INFO:teuthology.orchestra.run.trial104.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T08:05:15.319 INFO:teuthology.orchestra.run.trial104.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-13T08:05:15.325 DEBUG:teuthology.parallel:result is None 2026-02-13T08:05:15.326 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T08:05:15.494 DEBUG:teuthology.orchestra.run.trial104:> dpkg-query -W -f '${Version}' ceph 2026-02-13T08:05:15.503 INFO:teuthology.orchestra.run.trial104.stdout:20.2.0-636-g3b40640f-1jammy 2026-02-13T08:05:15.504 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-636-g3b40640f-1jammy 2026-02-13T08:05:15.504 INFO:teuthology.task.install:The correct ceph version 20.2.0-636-g3b40640f-1jammy is installed. 2026-02-13T08:05:15.506 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T08:05:15.652 DEBUG:teuthology.orchestra.run.trial119:> dpkg-query -W -f '${Version}' ceph 2026-02-13T08:05:15.662 INFO:teuthology.orchestra.run.trial119.stdout:20.2.0-636-g3b40640f-1jammy 2026-02-13T08:05:15.662 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-636-g3b40640f-1jammy 2026-02-13T08:05:15.662 INFO:teuthology.task.install:The correct ceph version 20.2.0-636-g3b40640f-1jammy is installed. 2026-02-13T08:05:15.664 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T08:05:15.664 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:15.664 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T08:05:15.675 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:15.675 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T08:05:15.713 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T08:05:15.713 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:15.713 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T08:05:15.726 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T08:05:15.777 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:15.777 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T08:05:15.788 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T08:05:15.839 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T08:05:15.839 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:15.840 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T08:05:15.850 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T08:05:15.897 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:15.897 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T08:05:15.907 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T08:05:15.955 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T08:05:15.955 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:15.956 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T08:05:15.966 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T08:05:16.013 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:16.013 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T08:05:16.022 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T08:05:16.071 INFO:teuthology.run_tasks:Running task ceph... 2026-02-13T08:05:16.186 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-13T08:05:16.186 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod 777 /var/log/ceph 2026-02-13T08:05:16.187 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 777 /var/log/ceph 2026-02-13T08:05:16.195 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-13T08:05:16.195 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-13T08:05:16.238 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-13T08:05:16.245 INFO:tasks.ceph:Creating extra log directories... 2026-02-13T08:05:16.246 DEBUG:teuthology.orchestra.run.trial104:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-13T08:05:16.287 DEBUG:teuthology.orchestra.run.trial119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-13T08:05:16.309 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-13T08:05:16.310 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'avl', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd_mclock_skip_benchmark': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_FULL\\)', '\\(SLOW_OPS\\)', '\\(MON_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'slow request'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2026-02-13T08:05:16.310 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874', 'branch': 'wip-bharath17-testing-2026-02-12-0618-tentacle', 'description': 'rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{avl} base mem$/{normal-2} onode-segment$/{512K} write$/{v2/{compr$/{yes$/{lz4}} v2}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_api_tests}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '47874', 'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'trial', 'name': 'skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-bharath17-testing-2026-02-12-0618-tentacle'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'avl', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd_mclock_skip_benchmark': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_FULL\\)', '\\(SLOW_OPS\\)', '\\(MON_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'slow request'], 'mon_bind_msgr2': False, 'sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath17-testing-2026-02-12-0618-tentacle', 'sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'}}, 'owner': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'priority': 80, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'osd.0', 'osd.1', 'osd.2'], ['mon.b', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 2723, 'sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath17-testing-2026-02-12-0618-tentacle', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb', 'targets': {'trial104.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFNeaKPCwCyoPwnH4h4T+NzxDi3zM0w/p1SVX4uebXDJ/uns43ik/HKWQ4cVw0GXpZD2/PGPi2OYP3DKBTE+Hf0=', 'trial119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBlWFH1RywrjD6t12EIGVnjZb0oehWKmnmaloznZaiqPeOQFp16CAZnZXVZy2xOisWRUYQH/yM2XULW3GtGVv80='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'thrash_delay': 1, 'thrash_many': True}}, {'workunit': {'clients': {'client.0': ['rados/test.sh unit_test_scan']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8bec0da71becad44414c54979f64c9ef0e7099c6', 'timestamp': '2026-02-13_01:43:11', 'tube': 'trial', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482'} 2026-02-13T08:05:16.311 DEBUG:teuthology.orchestra.run.trial104:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-13T08:05:16.335 DEBUG:teuthology.orchestra.run.trial119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-13T08:05:16.340 DEBUG:teuthology.orchestra.run.trial104:> sudo install -d -m0777 -- /var/run/ceph 2026-02-13T08:05:16.379 DEBUG:teuthology.orchestra.run.trial119:> sudo install -d -m0777 -- /var/run/ceph 2026-02-13T08:05:16.387 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:16.388 DEBUG:teuthology.orchestra.run.trial104:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T08:05:16.429 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T08:05:16.430 DEBUG:teuthology.orchestra.run.trial104:> stat /dev/vg_nvme/lv_1 2026-02-13T08:05:16.473 INFO:teuthology.orchestra.run.trial104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T08:05:16.473 INFO:teuthology.orchestra.run.trial104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T08:05:16.474 INFO:teuthology.orchestra.run.trial104.stdout:Device: 5h/5d Inode: 900 Links: 1 2026-02-13T08:05:16.474 INFO:teuthology.orchestra.run.trial104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T08:05:16.474 INFO:teuthology.orchestra.run.trial104.stdout:Access: 2026-02-13 08:04:25.788708748 +0000 2026-02-13T08:05:16.474 INFO:teuthology.orchestra.run.trial104.stdout:Modify: 2026-02-13 08:04:25.608714490 +0000 2026-02-13T08:05:16.474 INFO:teuthology.orchestra.run.trial104.stdout:Change: 2026-02-13 08:04:25.608714490 +0000 2026-02-13T08:05:16.474 INFO:teuthology.orchestra.run.trial104.stdout: Birth: - 2026-02-13T08:05:16.474 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T08:05:16.520 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records in 2026-02-13T08:05:16.520 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records out 2026-02-13T08:05:16.521 INFO:teuthology.orchestra.run.trial104.stderr:512 bytes copied, 0.000167068 s, 3.1 MB/s 2026-02-13T08:05:16.522 DEBUG:teuthology.orchestra.run.trial104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T08:05:16.567 DEBUG:teuthology.orchestra.run.trial104:> stat /dev/vg_nvme/lv_2 2026-02-13T08:05:16.613 INFO:teuthology.orchestra.run.trial104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T08:05:16.614 INFO:teuthology.orchestra.run.trial104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T08:05:16.614 INFO:teuthology.orchestra.run.trial104.stdout:Device: 5h/5d Inode: 922 Links: 1 2026-02-13T08:05:16.614 INFO:teuthology.orchestra.run.trial104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T08:05:16.614 INFO:teuthology.orchestra.run.trial104.stdout:Access: 2026-02-13 08:04:26.132697777 +0000 2026-02-13T08:05:16.614 INFO:teuthology.orchestra.run.trial104.stdout:Modify: 2026-02-13 08:04:25.952703519 +0000 2026-02-13T08:05:16.614 INFO:teuthology.orchestra.run.trial104.stdout:Change: 2026-02-13 08:04:25.952703519 +0000 2026-02-13T08:05:16.614 INFO:teuthology.orchestra.run.trial104.stdout: Birth: - 2026-02-13T08:05:16.614 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T08:05:16.660 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records in 2026-02-13T08:05:16.661 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records out 2026-02-13T08:05:16.661 INFO:teuthology.orchestra.run.trial104.stderr:512 bytes copied, 0.000175284 s, 2.9 MB/s 2026-02-13T08:05:16.662 DEBUG:teuthology.orchestra.run.trial104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T08:05:16.711 DEBUG:teuthology.orchestra.run.trial104:> stat /dev/vg_nvme/lv_3 2026-02-13T08:05:16.761 INFO:teuthology.orchestra.run.trial104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T08:05:16.761 INFO:teuthology.orchestra.run.trial104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T08:05:16.761 INFO:teuthology.orchestra.run.trial104.stdout:Device: 5h/5d Inode: 959 Links: 1 2026-02-13T08:05:16.762 INFO:teuthology.orchestra.run.trial104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T08:05:16.762 INFO:teuthology.orchestra.run.trial104.stdout:Access: 2026-02-13 08:04:26.468687062 +0000 2026-02-13T08:05:16.762 INFO:teuthology.orchestra.run.trial104.stdout:Modify: 2026-02-13 08:04:26.292692675 +0000 2026-02-13T08:05:16.762 INFO:teuthology.orchestra.run.trial104.stdout:Change: 2026-02-13 08:04:26.292692675 +0000 2026-02-13T08:05:16.762 INFO:teuthology.orchestra.run.trial104.stdout: Birth: - 2026-02-13T08:05:16.762 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T08:05:16.808 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records in 2026-02-13T08:05:16.808 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records out 2026-02-13T08:05:16.809 INFO:teuthology.orchestra.run.trial104.stderr:512 bytes copied, 0.000162389 s, 3.2 MB/s 2026-02-13T08:05:16.810 DEBUG:teuthology.orchestra.run.trial104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T08:05:16.859 DEBUG:teuthology.orchestra.run.trial104:> stat /dev/vg_nvme/lv_4 2026-02-13T08:05:16.905 INFO:teuthology.orchestra.run.trial104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T08:05:16.905 INFO:teuthology.orchestra.run.trial104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T08:05:16.906 INFO:teuthology.orchestra.run.trial104.stdout:Device: 5h/5d Inode: 972 Links: 1 2026-02-13T08:05:16.906 INFO:teuthology.orchestra.run.trial104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T08:05:16.906 INFO:teuthology.orchestra.run.trial104.stdout:Access: 2026-02-13 08:04:26.836675324 +0000 2026-02-13T08:05:16.906 INFO:teuthology.orchestra.run.trial104.stdout:Modify: 2026-02-13 08:04:26.636681702 +0000 2026-02-13T08:05:16.906 INFO:teuthology.orchestra.run.trial104.stdout:Change: 2026-02-13 08:04:26.636681702 +0000 2026-02-13T08:05:16.906 INFO:teuthology.orchestra.run.trial104.stdout: Birth: - 2026-02-13T08:05:16.906 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T08:05:16.953 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records in 2026-02-13T08:05:16.953 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records out 2026-02-13T08:05:16.953 INFO:teuthology.orchestra.run.trial104.stderr:512 bytes copied, 0.000162269 s, 3.2 MB/s 2026-02-13T08:05:16.954 DEBUG:teuthology.orchestra.run.trial104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T08:05:17.003 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T08:05:17.003 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:17.003 DEBUG:teuthology.orchestra.run.trial119:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T08:05:17.009 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T08:05:17.009 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_1 2026-02-13T08:05:17.055 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T08:05:17.056 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T08:05:17.056 INFO:teuthology.orchestra.run.trial119.stdout:Device: 5h/5d Inode: 915 Links: 1 2026-02-13T08:05:17.056 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T08:05:17.056 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-13 08:04:28.967660428 +0000 2026-02-13T08:05:17.056 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-13 08:04:28.795665906 +0000 2026-02-13T08:05:17.056 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-13 08:04:28.795665906 +0000 2026-02-13T08:05:17.056 INFO:teuthology.orchestra.run.trial119.stdout: Birth: - 2026-02-13T08:05:17.057 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T08:05:17.103 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-13T08:05:17.103 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-13T08:05:17.103 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000172508 s, 3.0 MB/s 2026-02-13T08:05:17.104 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T08:05:17.153 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_2 2026-02-13T08:05:17.199 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T08:05:17.199 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T08:05:17.199 INFO:teuthology.orchestra.run.trial119.stdout:Device: 5h/5d Inode: 927 Links: 1 2026-02-13T08:05:17.200 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T08:05:17.200 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-13 08:04:29.319649212 +0000 2026-02-13T08:05:17.200 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-13 08:04:29.123655458 +0000 2026-02-13T08:05:17.200 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-13 08:04:29.123655458 +0000 2026-02-13T08:05:17.200 INFO:teuthology.orchestra.run.trial119.stdout: Birth: - 2026-02-13T08:05:17.200 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T08:05:17.246 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-13T08:05:17.247 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-13T08:05:17.247 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000169253 s, 3.0 MB/s 2026-02-13T08:05:17.248 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T08:05:17.293 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_3 2026-02-13T08:05:17.339 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T08:05:17.339 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T08:05:17.340 INFO:teuthology.orchestra.run.trial119.stdout:Device: 5h/5d Inode: 950 Links: 1 2026-02-13T08:05:17.340 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T08:05:17.340 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-13 08:04:29.699637105 +0000 2026-02-13T08:05:17.340 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-13 08:04:29.515642968 +0000 2026-02-13T08:05:17.340 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-13 08:04:29.515642968 +0000 2026-02-13T08:05:17.340 INFO:teuthology.orchestra.run.trial119.stdout: Birth: - 2026-02-13T08:05:17.340 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T08:05:17.386 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-13T08:05:17.387 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-13T08:05:17.387 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000165976 s, 3.1 MB/s 2026-02-13T08:05:17.388 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T08:05:17.437 DEBUG:teuthology.orchestra.run.trial119:> stat /dev/vg_nvme/lv_4 2026-02-13T08:05:17.483 INFO:teuthology.orchestra.run.trial119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T08:05:17.484 INFO:teuthology.orchestra.run.trial119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T08:05:17.484 INFO:teuthology.orchestra.run.trial119.stdout:Device: 5h/5d Inode: 975 Links: 1 2026-02-13T08:05:17.484 INFO:teuthology.orchestra.run.trial119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T08:05:17.484 INFO:teuthology.orchestra.run.trial119.stdout:Access: 2026-02-13 08:04:30.063625510 +0000 2026-02-13T08:05:17.484 INFO:teuthology.orchestra.run.trial119.stdout:Modify: 2026-02-13 08:04:29.879631372 +0000 2026-02-13T08:05:17.484 INFO:teuthology.orchestra.run.trial119.stdout:Change: 2026-02-13 08:04:29.879631372 +0000 2026-02-13T08:05:17.484 INFO:teuthology.orchestra.run.trial119.stdout: Birth: - 2026-02-13T08:05:17.484 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T08:05:17.531 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records in 2026-02-13T08:05:17.531 INFO:teuthology.orchestra.run.trial119.stderr:1+0 records out 2026-02-13T08:05:17.531 INFO:teuthology.orchestra.run.trial119.stderr:512 bytes copied, 0.000174402 s, 2.9 MB/s 2026-02-13T08:05:17.532 DEBUG:teuthology.orchestra.run.trial119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T08:05:17.581 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T08:05:17.581 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial119.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-13T08:05:17.581 INFO:tasks.ceph:Generating config... 2026-02-13T08:05:17.584 INFO:tasks.ceph:[client] debug monc = 20 2026-02-13T08:05:17.584 INFO:tasks.ceph:[client] debug ms = 1 2026-02-13T08:05:17.584 INFO:tasks.ceph:[global] debug ms = 1 2026-02-13T08:05:17.584 INFO:tasks.ceph:[global] debug objecter = 20 2026-02-13T08:05:17.584 INFO:tasks.ceph:[global] debug rados = 20 2026-02-13T08:05:17.584 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-13T08:05:17.584 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-13T08:05:17.584 INFO:tasks.ceph:[global] ms bind msgr2 = False 2026-02-13T08:05:17.584 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2026-02-13T08:05:17.584 INFO:tasks.ceph:[global] ms type = async 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mon] debug mon = 20 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mon] debug ms = 1 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-13T08:05:17.585 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2026-02-13T08:05:17.586 INFO:tasks.ceph:[mon] paxos min = 10 2026-02-13T08:05:17.586 INFO:tasks.ceph:[mon] paxos service trim min = 5 2026-02-13T08:05:17.586 INFO:tasks.ceph:[mon] paxos trim min = 10 2026-02-13T08:05:17.586 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-13T08:05:17.586 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-13T08:05:17.586 INFO:tasks.ceph:[osd] bluestore allocator = avl 2026-02-13T08:05:17.586 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-13T08:05:17.586 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2026-02-13T08:05:17.586 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2026-02-13T08:05:17.586 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-13T08:05:17.586 INFO:tasks.ceph:[osd] bluestore onode segment size = 512K 2026-02-13T08:05:17.586 INFO:tasks.ceph:[osd] bluestore write v2 = True 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] osd class default list = * 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] osd class load list = * 2026-02-13T08:05:17.587 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-13T08:05:17.588 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-13T08:05:17.588 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-13T08:05:17.588 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-13T08:05:17.588 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-13T08:05:17.588 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-13T08:05:17.588 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-13T08:05:17.588 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-13T08:05:17.588 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-13T08:05:17.588 INFO:tasks.ceph:[osd] osd_mclock_skip_benchmark = True 2026-02-13T08:05:17.588 INFO:tasks.ceph:Setting up mon.a... 2026-02-13T08:05:17.589 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-13T08:05:17.606 INFO:teuthology.orchestra.run.trial104.stdout:creating /etc/ceph/ceph.keyring 2026-02-13T08:05:17.610 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-13T08:05:17.669 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T08:05:17.721 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:10.20.193.104:6789]'), ('mon.c', '[v1:10.20.193.104:6790]'), ('mon.b', '[v1:10.20.193.119:6789]')] 2026-02-13T08:05:17.722 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:10.20.193.104:6789],[v1:10.20.193.104:6790],[v1:10.20.193.119:6789]', 'debug ms': 1, 'debug objecter': 20, 'debug rados': 20, 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'avl', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore onode segment size': '512K', 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd class default list': '*', 'osd class load list': '*', 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random', 'osd_mclock_skip_benchmark': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'mon warn on pool no app': False, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2026-02-13T08:05:17.724 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:17.724 DEBUG:teuthology.orchestra.run.trial104:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-13T08:05:17.766 DEBUG:teuthology.orchestra.run.trial104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:10.20.193.104:6789]' --addv c '[v1:10.20.193.104:6790]' --addv b '[v1:10.20.193.119:6789]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:17.828 INFO:teuthology.orchestra.run.trial104.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:17.829 INFO:teuthology.orchestra.run.trial104.stdout:monmaptool: generated fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:17.829 INFO:teuthology.orchestra.run.trial104.stdout:setting min_mon_release = tentacle 2026-02-13T08:05:17.829 INFO:teuthology.orchestra.run.trial104.stdout:epoch 0 2026-02-13T08:05:17.829 INFO:teuthology.orchestra.run.trial104.stdout:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:17.829 INFO:teuthology.orchestra.run.trial104.stdout:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:17.829 INFO:teuthology.orchestra.run.trial104.stdout:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:17.829 INFO:teuthology.orchestra.run.trial104.stdout:min_mon_release 20 (tentacle) 2026-02-13T08:05:17.829 INFO:teuthology.orchestra.run.trial104.stdout:election_strategy: 1 2026-02-13T08:05:17.829 INFO:teuthology.orchestra.run.trial104.stdout:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:17.830 INFO:teuthology.orchestra.run.trial104.stdout:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:17.830 INFO:teuthology.orchestra.run.trial104.stdout:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:17.830 INFO:teuthology.orchestra.run.trial104.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2026-02-13T08:05:17.831 DEBUG:teuthology.orchestra.run.trial104:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-13T08:05:17.877 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0e1d0140-145d-4ea8-a799-1ca564383c2b... 2026-02-13T08:05:17.878 DEBUG:teuthology.orchestra.run.trial104:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-13T08:05:17.919 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-13T08:05:17.937 INFO:teuthology.orchestra.run.trial104.stdout:[global] 2026-02-13T08:05:17.937 INFO:teuthology.orchestra.run.trial104.stdout: chdir = "" 2026-02-13T08:05:17.938 INFO:teuthology.orchestra.run.trial104.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-13T08:05:17.938 INFO:teuthology.orchestra.run.trial104.stdout: auth supported = cephx 2026-02-13T08:05:17.938 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.938 INFO:teuthology.orchestra.run.trial104.stdout: filestore xattr use omap = true 2026-02-13T08:05:17.938 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.938 INFO:teuthology.orchestra.run.trial104.stdout: mon clock drift allowed = 1.000 2026-02-13T08:05:17.938 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.938 INFO:teuthology.orchestra.run.trial104.stdout: osd crush chooseleaf type = 0 2026-02-13T08:05:17.938 INFO:teuthology.orchestra.run.trial104.stdout: auth debug = true 2026-02-13T08:05:17.938 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: ms die on old message = true 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: ms die on bug = true 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: mon pg warn max object skew = 0 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: # disable pg_autoscaler by default for new pools 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: osd pool default size = 2 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.939 INFO:teuthology.orchestra.run.trial104.stdout: mon osd allow primary affinity = true 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: mon osd allow pg remap = true 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: mon warn on legacy crush tunables = false 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: mon warn on crush straw calc version zero = false 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: mon warn on no sortbitwise = false 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: mon warn on osd down out interval zero = false 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: mon warn on too few osds = false 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: mon_allow_pool_size_one = true 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T08:05:17.940 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: osd default data pool replay window = 5 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: mon allow pool delete = true 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: mon cluster log file level = debug 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: debug asserts on shutdown = true 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: mon health detail to clog = false 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: mon host = "[v1:10.20.193.104:6789],[v1:10.20.193.104:6790],[v1:10.20.193.119:6789]" 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: debug ms = 1 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: debug objecter = 20 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: debug rados = 20 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: mon client directed command retry = 5 2026-02-13T08:05:17.941 INFO:teuthology.orchestra.run.trial104.stdout: mon election default strategy = 1 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: ms bind msgr2 = False 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: ms inject socket failures = 5000 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: ms type = async 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: fsid = 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout:[osd] 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: osd journal size = 100 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: osd scrub load threshold = 5.0 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: osd scrub max interval = 600 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: osd mclock profile = high_recovery_ops 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: osd mclock skip benchmark = True 2026-02-13T08:05:17.942 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: osd recover clone overlap = true 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: osd recovery max chunk = 1048576 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: osd debug shutdown = true 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: osd debug op order = true 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: osd debug verify stray on activate = true 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: osd debug trim objects = true 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: osd open classes on start = true 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: osd debug pg log writeout = true 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.943 INFO:teuthology.orchestra.run.trial104.stdout: osd deep scrub update digest min age = 30 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: osd map max advance = 10 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: journal zero on create = true 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: filestore ondisk finisher threads = 3 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: filestore apply finisher threads = 3 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: bdev debug aio = true 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: osd debug misdirected ops = true 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: bdev async discard = True 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: bdev enable discard = True 2026-02-13T08:05:17.944 INFO:teuthology.orchestra.run.trial104.stdout: bluestore allocator = avl 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: bluestore block size = 96636764160 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: bluestore compression algorithm = lz4 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: bluestore compression mode = aggressive 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: bluestore fsck on mount = True 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: bluestore onode segment size = 512K 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: bluestore write v2 = True 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: bluestore zero block detection = True 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: debug bluefs = 20 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: debug bluestore = 20 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: debug ms = 1 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: debug osd = 20 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: debug rocksdb = 10 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: mon osd backfillfull_ratio = 0.85 2026-02-13T08:05:17.945 INFO:teuthology.orchestra.run.trial104.stdout: mon osd full ratio = 0.9 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: mon osd nearfull ratio = 0.8 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: osd class default list = * 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: osd class load list = * 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: osd debug verify cached snaps = True 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: osd debug verify missing on start = True 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: osd failsafe full ratio = 0.95 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: osd mclock override recovery settings = True 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: osd objectstore = bluestore 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: osd op queue = debug_random 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: osd op queue cut off = debug_random 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: osd_mclock_skip_benchmark = True 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.946 INFO:teuthology.orchestra.run.trial104.stdout:[mgr] 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: debug ms = 1 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: debug mgr = 20 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: debug mon = 20 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: debug auth = 20 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: mon reweight min pgs per osd = 4 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: mon reweight min bytes per osd = 10 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: mgr/telemetry/nag = false 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout:[mon] 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: debug ms = 1 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: debug mon = 20 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: debug paxos = 20 2026-02-13T08:05:17.947 INFO:teuthology.orchestra.run.trial104.stdout: debug auth = 20 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: mon data avail warn = 5 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: mon mgr mkfs grace = 240 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: mon reweight min pgs per osd = 4 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: mon osd reporter subtree level = osd 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: mon osd prime pg temp = true 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: mon reweight min bytes per osd = 10 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: auth mon ticket ttl = 660 # 11m 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: auth service ticket ttl = 240 # 4m 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: # don't complain about insecure global_id in the test suite 2026-02-13T08:05:17.948 INFO:teuthology.orchestra.run.trial104.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: # 1m isn't quite enough 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: mon_down_mkfs_grace = 2m 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: mon_warn_on_filestore_osds = false 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: mon min osdmap epochs = 25 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: mon osdmap full prune interval = 2 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: mon osdmap full prune min = 15 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: mon osdmap full prune txsize = 2 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: mon scrub inject crc mismatch = 0.01 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: mon scrub inject missing keys = 0.05 2026-02-13T08:05:17.949 INFO:teuthology.orchestra.run.trial104.stdout: mon scrub interval = 300 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: mon warn on pool no app = False 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: paxos min = 10 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: paxos service trim min = 5 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: paxos trim min = 10 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout:[client] 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: rgw cache enabled = true 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: rgw enable ops log = true 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: rgw enable usage log = true 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: debug monc = 20 2026-02-13T08:05:17.950 INFO:teuthology.orchestra.run.trial104.stdout: debug ms = 1 2026-02-13T08:05:17.951 INFO:teuthology.orchestra.run.trial104.stdout:[mon.a] 2026-02-13T08:05:17.951 INFO:teuthology.orchestra.run.trial104.stdout:[mon.c] 2026-02-13T08:05:17.951 INFO:teuthology.orchestra.run.trial104.stdout:[mon.b] 2026-02-13T08:05:17.952 INFO:teuthology.orchestra.run.trial119.stdout:[global] 2026-02-13T08:05:17.953 INFO:teuthology.orchestra.run.trial119.stdout: chdir = "" 2026-02-13T08:05:17.953 INFO:teuthology.orchestra.run.trial119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-13T08:05:17.953 INFO:teuthology.orchestra.run.trial119.stdout: auth supported = cephx 2026-02-13T08:05:17.953 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.953 INFO:teuthology.orchestra.run.trial119.stdout: filestore xattr use omap = true 2026-02-13T08:05:17.953 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.953 INFO:teuthology.orchestra.run.trial119.stdout: mon clock drift allowed = 1.000 2026-02-13T08:05:17.953 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.953 INFO:teuthology.orchestra.run.trial119.stdout: osd crush chooseleaf type = 0 2026-02-13T08:05:17.953 INFO:teuthology.orchestra.run.trial119.stdout: auth debug = true 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: ms die on old message = true 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: ms die on bug = true 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: mon pg warn max object skew = 0 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: # disable pg_autoscaler by default for new pools 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: osd pool default size = 2 2026-02-13T08:05:17.954 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: mon osd allow primary affinity = true 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: mon osd allow pg remap = true 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on legacy crush tunables = false 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on crush straw calc version zero = false 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on no sortbitwise = false 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on osd down out interval zero = false 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on too few osds = false 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: mon_allow_pool_size_one = true 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.955 INFO:teuthology.orchestra.run.trial119.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: osd default data pool replay window = 5 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: mon allow pool delete = true 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: mon cluster log file level = debug 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: debug asserts on shutdown = true 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: mon health detail to clog = false 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: mon host = "[v1:10.20.193.104:6789],[v1:10.20.193.104:6790],[v1:10.20.193.119:6789]" 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: debug objecter = 20 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: debug rados = 20 2026-02-13T08:05:17.956 INFO:teuthology.orchestra.run.trial119.stdout: mon client directed command retry = 5 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout: mon election default strategy = 1 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout: ms bind msgr2 = False 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout: ms inject socket failures = 5000 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout: ms type = async 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout: fsid = 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout:[osd] 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout: osd journal size = 100 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout: osd scrub load threshold = 5.0 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout: osd scrub max interval = 600 2026-02-13T08:05:17.957 INFO:teuthology.orchestra.run.trial119.stdout: osd mclock profile = high_recovery_ops 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: osd mclock skip benchmark = True 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: osd recover clone overlap = true 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: osd recovery max chunk = 1048576 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: osd debug shutdown = true 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: osd debug op order = true 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: osd debug verify stray on activate = true 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: osd debug trim objects = true 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: osd open classes on start = true 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: osd debug pg log writeout = true 2026-02-13T08:05:17.958 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: osd deep scrub update digest min age = 30 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: osd map max advance = 10 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: journal zero on create = true 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: filestore ondisk finisher threads = 3 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: filestore apply finisher threads = 3 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: bdev debug aio = true 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: osd debug misdirected ops = true 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: bdev async discard = True 2026-02-13T08:05:17.959 INFO:teuthology.orchestra.run.trial119.stdout: bdev enable discard = True 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: bluestore allocator = avl 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: bluestore block size = 96636764160 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: bluestore compression algorithm = lz4 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: bluestore compression mode = aggressive 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: bluestore fsck on mount = True 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: bluestore onode segment size = 512K 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: bluestore write v2 = True 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: bluestore zero block detection = True 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: debug bluefs = 20 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: debug bluestore = 20 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: debug osd = 20 2026-02-13T08:05:17.960 INFO:teuthology.orchestra.run.trial119.stdout: debug rocksdb = 10 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: mon osd backfillfull_ratio = 0.85 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: mon osd full ratio = 0.9 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: mon osd nearfull ratio = 0.8 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: osd class default list = * 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: osd class load list = * 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: osd debug verify cached snaps = True 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: osd debug verify missing on start = True 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: osd failsafe full ratio = 0.95 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: osd mclock override recovery settings = True 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: osd objectstore = bluestore 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: osd op queue = debug_random 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: osd op queue cut off = debug_random 2026-02-13T08:05:17.961 INFO:teuthology.orchestra.run.trial119.stdout: osd_mclock_skip_benchmark = True 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout:[mgr] 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout: debug mgr = 20 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout: debug mon = 20 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout: debug auth = 20 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min pgs per osd = 4 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min bytes per osd = 10 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout: mgr/telemetry/nag = false 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout:[mon] 2026-02-13T08:05:17.962 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: debug mon = 20 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: debug paxos = 20 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: debug auth = 20 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: mon data avail warn = 5 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: mon mgr mkfs grace = 240 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min pgs per osd = 4 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: mon osd reporter subtree level = osd 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: mon osd prime pg temp = true 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: mon reweight min bytes per osd = 10 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-13T08:05:17.963 INFO:teuthology.orchestra.run.trial119.stdout: auth mon ticket ttl = 660 # 11m 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: auth service ticket ttl = 240 # 4m 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: # don't complain about insecure global_id in the test suite 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: # 1m isn't quite enough 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: mon_down_mkfs_grace = 2m 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: mon_warn_on_filestore_osds = false 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: mon min osdmap epochs = 25 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: mon osdmap full prune interval = 2 2026-02-13T08:05:17.964 INFO:teuthology.orchestra.run.trial119.stdout: mon osdmap full prune min = 15 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: mon osdmap full prune txsize = 2 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: mon scrub inject crc mismatch = 0.01 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: mon scrub inject missing keys = 0.05 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: mon scrub interval = 300 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: mon warn on pool no app = False 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: paxos min = 10 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: paxos service trim min = 5 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: paxos trim min = 10 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout:[client] 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: rgw cache enabled = true 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: rgw enable ops log = true 2026-02-13T08:05:17.965 INFO:teuthology.orchestra.run.trial119.stdout: rgw enable usage log = true 2026-02-13T08:05:17.966 INFO:teuthology.orchestra.run.trial119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-13T08:05:17.966 INFO:teuthology.orchestra.run.trial119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-13T08:05:17.966 INFO:teuthology.orchestra.run.trial119.stdout: debug monc = 20 2026-02-13T08:05:17.966 INFO:teuthology.orchestra.run.trial119.stdout: debug ms = 1 2026-02-13T08:05:17.966 INFO:teuthology.orchestra.run.trial119.stdout:[mon.a] 2026-02-13T08:05:17.966 INFO:teuthology.orchestra.run.trial119.stdout:[mon.c] 2026-02-13T08:05:17.966 INFO:teuthology.orchestra.run.trial119.stdout:[mon.b] 2026-02-13T08:05:17.966 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-13T08:05:17.967 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-13T08:05:18.016 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-13T08:05:18.016 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:18.016 DEBUG:teuthology.orchestra.run.trial104:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-13T08:05:18.062 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:18.062 DEBUG:teuthology.orchestra.run.trial104:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-13T08:05:18.114 INFO:tasks.ceph:Sending monmap to node ubuntu@trial104.front.sepia.ceph.com 2026-02-13T08:05:18.115 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:18.115 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-13T08:05:18.115 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T08:05:18.172 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:18.172 DEBUG:teuthology.orchestra.run.trial104:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:18.217 INFO:tasks.ceph:Sending monmap to node ubuntu@trial119.front.sepia.ceph.com 2026-02-13T08:05:18.218 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:18.218 DEBUG:teuthology.orchestra.run.trial119:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-13T08:05:18.218 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-13T08:05:18.233 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:18.233 DEBUG:teuthology.orchestra.run.trial119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:18.280 INFO:tasks.ceph:Setting up mon nodes... 2026-02-13T08:05:18.280 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-13T08:05:18.280 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-13T08:05:18.342 INFO:teuthology.orchestra.run.trial119.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-13T08:05:18.345 INFO:tasks.ceph:Setting up mds nodes... 2026-02-13T08:05:18.345 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-13T08:05:18.346 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T08:05:18.404 INFO:teuthology.orchestra.run.trial119.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-13T08:05:18.411 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-13T08:05:18.411 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial104.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial119.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-13T08:05:18.411 DEBUG:teuthology.orchestra.run.trial104:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-13T08:05:18.421 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T08:05:18.421 INFO:tasks.ceph:role: osd.0 2026-02-13T08:05:18.421 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial104.front.sepia.ceph.com 2026-02-13T08:05:18.421 DEBUG:teuthology.orchestra.run.trial104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-13T08:05:18.471 INFO:teuthology.orchestra.run.trial104.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T08:05:18.471 INFO:teuthology.orchestra.run.trial104.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T08:05:18.471 INFO:teuthology.orchestra.run.trial104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T08:05:18.471 INFO:teuthology.orchestra.run.trial104.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T08:05:18.471 INFO:teuthology.orchestra.run.trial104.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T08:05:18.471 INFO:teuthology.orchestra.run.trial104.stdout: = sunit=0 swidth=0 blks 2026-02-13T08:05:18.471 INFO:teuthology.orchestra.run.trial104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T08:05:18.471 INFO:teuthology.orchestra.run.trial104.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T08:05:18.472 INFO:teuthology.orchestra.run.trial104.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T08:05:18.472 INFO:teuthology.orchestra.run.trial104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T08:05:19.084 INFO:teuthology.orchestra.run.trial104.stdout:Discarding blocks...Done. 2026-02-13T08:05:19.085 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial104.front.sepia.ceph.com -o noatime 2026-02-13T08:05:19.086 DEBUG:teuthology.orchestra.run.trial104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-13T08:05:19.142 DEBUG:teuthology.orchestra.run.trial104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-13T08:05:19.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T08:05:19.192 INFO:teuthology.orchestra.run.trial104.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T08:05:19.192 DEBUG:teuthology.orchestra.run.trial104:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-13T08:05:19.242 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T08:05:19.242 INFO:tasks.ceph:role: osd.1 2026-02-13T08:05:19.242 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial104.front.sepia.ceph.com 2026-02-13T08:05:19.242 DEBUG:teuthology.orchestra.run.trial104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-13T08:05:19.292 INFO:teuthology.orchestra.run.trial104.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T08:05:19.292 INFO:teuthology.orchestra.run.trial104.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T08:05:19.292 INFO:teuthology.orchestra.run.trial104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T08:05:19.292 INFO:teuthology.orchestra.run.trial104.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T08:05:19.292 INFO:teuthology.orchestra.run.trial104.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T08:05:19.292 INFO:teuthology.orchestra.run.trial104.stdout: = sunit=0 swidth=0 blks 2026-02-13T08:05:19.292 INFO:teuthology.orchestra.run.trial104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T08:05:19.292 INFO:teuthology.orchestra.run.trial104.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T08:05:19.293 INFO:teuthology.orchestra.run.trial104.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T08:05:19.293 INFO:teuthology.orchestra.run.trial104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T08:05:19.857 INFO:teuthology.orchestra.run.trial104.stdout:Discarding blocks...Done. 2026-02-13T08:05:19.859 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial104.front.sepia.ceph.com -o noatime 2026-02-13T08:05:19.859 DEBUG:teuthology.orchestra.run.trial104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-13T08:05:19.919 DEBUG:teuthology.orchestra.run.trial104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-13T08:05:19.967 INFO:teuthology.orchestra.run.trial104.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T08:05:19.968 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T08:05:19.968 DEBUG:teuthology.orchestra.run.trial104:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-13T08:05:20.021 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-13T08:05:20.022 INFO:tasks.ceph:role: osd.2 2026-02-13T08:05:20.022 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial104.front.sepia.ceph.com 2026-02-13T08:05:20.022 DEBUG:teuthology.orchestra.run.trial104:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-13T08:05:20.071 INFO:teuthology.orchestra.run.trial104.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T08:05:20.071 INFO:teuthology.orchestra.run.trial104.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T08:05:20.071 INFO:teuthology.orchestra.run.trial104.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T08:05:20.071 INFO:teuthology.orchestra.run.trial104.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T08:05:20.071 INFO:teuthology.orchestra.run.trial104.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T08:05:20.071 INFO:teuthology.orchestra.run.trial104.stdout: = sunit=0 swidth=0 blks 2026-02-13T08:05:20.071 INFO:teuthology.orchestra.run.trial104.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T08:05:20.071 INFO:teuthology.orchestra.run.trial104.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T08:05:20.072 INFO:teuthology.orchestra.run.trial104.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T08:05:20.072 INFO:teuthology.orchestra.run.trial104.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T08:05:20.639 INFO:teuthology.orchestra.run.trial104.stdout:Discarding blocks...Done. 2026-02-13T08:05:20.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial104.front.sepia.ceph.com -o noatime 2026-02-13T08:05:20.641 DEBUG:teuthology.orchestra.run.trial104:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-13T08:05:20.695 DEBUG:teuthology.orchestra.run.trial104:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-13T08:05:20.743 INFO:teuthology.orchestra.run.trial104.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T08:05:20.744 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T08:05:20.744 DEBUG:teuthology.orchestra.run.trial104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:20.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:20.801+0000 7f88b3258a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-13T08:05:20.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:20.801+0000 7f88b3258a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-13T08:05:20.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:20.801+0000 7f88b3258a40 -1 bdev(0x55b421b81800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-13T08:05:20.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:20.801+0000 7f88b3258a40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-13T08:05:21.695 DEBUG:teuthology.orchestra.run.trial104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-13T08:05:21.751 DEBUG:teuthology.orchestra.run.trial104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:21.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:21.809+0000 7fecb2480a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-13T08:05:21.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:21.809+0000 7fecb2480a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-13T08:05:21.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:21.809+0000 7fecb2480a40 -1 bdev(0x56308f5bb800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-13T08:05:21.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:21.809+0000 7fecb2480a40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-13T08:05:22.737 DEBUG:teuthology.orchestra.run.trial104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-13T08:05:22.787 DEBUG:teuthology.orchestra.run.trial104:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:22.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:22.845+0000 7feb5c482a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-13T08:05:22.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:22.845+0000 7feb5c482a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-13T08:05:22.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:22.845+0000 7feb5c482a40 -1 bdev(0x55bf4930b800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-13T08:05:22.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:22.845+0000 7feb5c482a40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-13T08:05:23.754 DEBUG:teuthology.orchestra.run.trial104:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-13T08:05:23.806 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-13T08:05:23.816 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T08:05:23.816 INFO:tasks.ceph:role: osd.3 2026-02-13T08:05:23.816 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial119.front.sepia.ceph.com 2026-02-13T08:05:23.816 DEBUG:teuthology.orchestra.run.trial119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-13T08:05:23.869 INFO:teuthology.orchestra.run.trial119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T08:05:23.869 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T08:05:23.869 INFO:teuthology.orchestra.run.trial119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T08:05:23.869 INFO:teuthology.orchestra.run.trial119.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T08:05:23.869 INFO:teuthology.orchestra.run.trial119.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T08:05:23.869 INFO:teuthology.orchestra.run.trial119.stdout: = sunit=0 swidth=0 blks 2026-02-13T08:05:23.869 INFO:teuthology.orchestra.run.trial119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T08:05:23.870 INFO:teuthology.orchestra.run.trial119.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T08:05:23.870 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T08:05:23.870 INFO:teuthology.orchestra.run.trial119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T08:05:24.489 INFO:teuthology.orchestra.run.trial119.stdout:Discarding blocks...Done. 2026-02-13T08:05:24.491 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial119.front.sepia.ceph.com -o noatime 2026-02-13T08:05:24.491 DEBUG:teuthology.orchestra.run.trial119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-13T08:05:24.545 DEBUG:teuthology.orchestra.run.trial119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-13T08:05:24.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T08:05:24.594 INFO:teuthology.orchestra.run.trial119.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T08:05:24.594 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-13T08:05:24.644 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T08:05:24.644 INFO:tasks.ceph:role: osd.4 2026-02-13T08:05:24.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial119.front.sepia.ceph.com 2026-02-13T08:05:24.644 DEBUG:teuthology.orchestra.run.trial119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-13T08:05:24.697 INFO:teuthology.orchestra.run.trial119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T08:05:24.697 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T08:05:24.697 INFO:teuthology.orchestra.run.trial119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T08:05:24.698 INFO:teuthology.orchestra.run.trial119.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T08:05:24.698 INFO:teuthology.orchestra.run.trial119.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T08:05:24.698 INFO:teuthology.orchestra.run.trial119.stdout: = sunit=0 swidth=0 blks 2026-02-13T08:05:24.698 INFO:teuthology.orchestra.run.trial119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T08:05:24.698 INFO:teuthology.orchestra.run.trial119.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T08:05:24.698 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T08:05:24.698 INFO:teuthology.orchestra.run.trial119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T08:05:25.263 INFO:teuthology.orchestra.run.trial119.stdout:Discarding blocks...Done. 2026-02-13T08:05:25.265 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial119.front.sepia.ceph.com -o noatime 2026-02-13T08:05:25.265 DEBUG:teuthology.orchestra.run.trial119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-13T08:05:25.326 DEBUG:teuthology.orchestra.run.trial119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-13T08:05:25.377 INFO:teuthology.orchestra.run.trial119.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T08:05:25.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T08:05:25.379 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-13T08:05:25.428 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-13T08:05:25.428 INFO:tasks.ceph:role: osd.5 2026-02-13T08:05:25.428 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial119.front.sepia.ceph.com 2026-02-13T08:05:25.428 DEBUG:teuthology.orchestra.run.trial119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-13T08:05:25.481 INFO:teuthology.orchestra.run.trial119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-13T08:05:25.481 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-13T08:05:25.482 INFO:teuthology.orchestra.run.trial119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-13T08:05:25.482 INFO:teuthology.orchestra.run.trial119.stdout: = reflink=1 bigtime=0 inobtcount=0 2026-02-13T08:05:25.482 INFO:teuthology.orchestra.run.trial119.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-13T08:05:25.482 INFO:teuthology.orchestra.run.trial119.stdout: = sunit=0 swidth=0 blks 2026-02-13T08:05:25.482 INFO:teuthology.orchestra.run.trial119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-13T08:05:25.482 INFO:teuthology.orchestra.run.trial119.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-13T08:05:25.482 INFO:teuthology.orchestra.run.trial119.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-13T08:05:25.482 INFO:teuthology.orchestra.run.trial119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-13T08:05:26.062 INFO:teuthology.orchestra.run.trial119.stdout:Discarding blocks...Done. 2026-02-13T08:05:26.064 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial119.front.sepia.ceph.com -o noatime 2026-02-13T08:05:26.064 DEBUG:teuthology.orchestra.run.trial119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2026-02-13T08:05:26.121 DEBUG:teuthology.orchestra.run.trial119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-13T08:05:26.169 INFO:teuthology.orchestra.run.trial119.stderr:sudo: /sbin/restorecon: command not found 2026-02-13T08:05:26.170 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T08:05:26.170 DEBUG:teuthology.orchestra.run.trial119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:26.237 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:26.328+0000 7f124cbbfa40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-13T08:05:26.238 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:26.328+0000 7f124cbbfa40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-13T08:05:26.238 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:26.328+0000 7f124cbbfa40 -1 bdev(0x562c64caf800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-13T08:05:26.238 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:26.328+0000 7f124cbbfa40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-13T08:05:27.125 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-13T08:05:27.176 DEBUG:teuthology.orchestra.run.trial119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:27.241 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:27.332+0000 7ff1395c3a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-13T08:05:27.242 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:27.332+0000 7ff1395c3a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-13T08:05:27.242 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:27.332+0000 7ff1395c3a40 -1 bdev(0x559d55187800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-13T08:05:27.242 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:27.332+0000 7ff1395c3a40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-13T08:05:28.129 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-13T08:05:28.181 DEBUG:teuthology.orchestra.run.trial119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:28.244 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:28.336+0000 7ff8019b0a40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-13T08:05:28.245 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:28.336+0000 7ff8019b0a40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-13T08:05:28.245 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:28.336+0000 7ff8019b0a40 -1 bdev(0x55a4d1df3800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-13T08:05:28.245 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:28.336+0000 7ff8019b0a40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-13T08:05:29.115 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-13T08:05:29.165 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-13T08:05:29.165 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:29.165 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-13T08:05:29.176 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:29.176 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-13T08:05:29.227 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:29.227 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-13T08:05:29.279 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:29.279 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-13T08:05:29.290 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:29.290 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-13T08:05:29.341 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:29.341 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-13T08:05:29.392 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:29.393 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-13T08:05:29.445 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:29.445 DEBUG:teuthology.orchestra.run.trial119:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-13T08:05:29.492 INFO:tasks.ceph:Adding keys to all mons... 2026-02-13T08:05:29.493 DEBUG:teuthology.orchestra.run.trial104:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-13T08:05:29.495 DEBUG:teuthology.orchestra.run.trial119:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-13T08:05:29.538 INFO:teuthology.orchestra.run.trial104.stdout:[osd.0] 2026-02-13T08:05:29.538 INFO:teuthology.orchestra.run.trial104.stdout: key = AQBA245pmXMMMBAAzJb6dunAi9uy/GOvvZuJCA== 2026-02-13T08:05:29.538 INFO:teuthology.orchestra.run.trial104.stdout:[osd.1] 2026-02-13T08:05:29.539 INFO:teuthology.orchestra.run.trial104.stdout: key = AQBB245prZl2MBAAFuJSxfI56Bymj1fjOfr89w== 2026-02-13T08:05:29.539 INFO:teuthology.orchestra.run.trial104.stdout:[osd.2] 2026-02-13T08:05:29.539 INFO:teuthology.orchestra.run.trial104.stdout: key = AQBC245p9GyaMhAAHBHucSdI6YOURjHV0KBKsw== 2026-02-13T08:05:29.539 INFO:teuthology.orchestra.run.trial104.stdout:[mgr.x] 2026-02-13T08:05:29.539 INFO:teuthology.orchestra.run.trial104.stdout: key = AQA+245p9aTkGRAAlBoaV/GFkiEG7cz8yYbULg== 2026-02-13T08:05:29.539 INFO:teuthology.orchestra.run.trial104.stdout:[osd.3] 2026-02-13T08:05:29.539 INFO:teuthology.orchestra.run.trial104.stdout: key = AQBG245p5xmoExAANTEdiLUXzcu2SxO2SmiAvQ== 2026-02-13T08:05:29.539 INFO:teuthology.orchestra.run.trial104.stdout:[osd.4] 2026-02-13T08:05:29.539 INFO:teuthology.orchestra.run.trial104.stdout: key = AQBH245pRa/bExAAJ4L2rF3YkBVoDsVat3LXNQ== 2026-02-13T08:05:29.539 INFO:teuthology.orchestra.run.trial104.stdout:[osd.5] 2026-02-13T08:05:29.539 INFO:teuthology.orchestra.run.trial104.stdout: key = AQBI245pN0kRFBAAcvPWIarKZdu5C5M61z7xDQ== 2026-02-13T08:05:29.540 INFO:teuthology.orchestra.run.trial104.stdout:[client.0] 2026-02-13T08:05:29.540 INFO:teuthology.orchestra.run.trial104.stdout: key = AQA+245phz+YHRAAVtk5SmFfrIAOPuJG/bez9w== 2026-02-13T08:05:29.542 INFO:teuthology.orchestra.run.trial119.stdout:[osd.0] 2026-02-13T08:05:29.542 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBA245pmXMMMBAAzJb6dunAi9uy/GOvvZuJCA== 2026-02-13T08:05:29.543 INFO:teuthology.orchestra.run.trial119.stdout:[osd.1] 2026-02-13T08:05:29.543 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBB245prZl2MBAAFuJSxfI56Bymj1fjOfr89w== 2026-02-13T08:05:29.543 INFO:teuthology.orchestra.run.trial119.stdout:[osd.2] 2026-02-13T08:05:29.543 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBC245p9GyaMhAAHBHucSdI6YOURjHV0KBKsw== 2026-02-13T08:05:29.543 INFO:teuthology.orchestra.run.trial119.stdout:[mgr.x] 2026-02-13T08:05:29.543 INFO:teuthology.orchestra.run.trial119.stdout: key = AQA+245p9aTkGRAAlBoaV/GFkiEG7cz8yYbULg== 2026-02-13T08:05:29.543 INFO:teuthology.orchestra.run.trial119.stdout:[osd.3] 2026-02-13T08:05:29.543 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBG245p5xmoExAANTEdiLUXzcu2SxO2SmiAvQ== 2026-02-13T08:05:29.543 INFO:teuthology.orchestra.run.trial119.stdout:[osd.4] 2026-02-13T08:05:29.543 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBH245pRa/bExAAJ4L2rF3YkBVoDsVat3LXNQ== 2026-02-13T08:05:29.544 INFO:teuthology.orchestra.run.trial119.stdout:[osd.5] 2026-02-13T08:05:29.544 INFO:teuthology.orchestra.run.trial119.stdout: key = AQBI245pN0kRFBAAcvPWIarKZdu5C5M61z7xDQ== 2026-02-13T08:05:29.544 INFO:teuthology.orchestra.run.trial119.stdout:[client.0] 2026-02-13T08:05:29.544 INFO:teuthology.orchestra.run.trial119.stdout: key = AQA+245phz+YHRAAVtk5SmFfrIAOPuJG/bez9w== 2026-02-13T08:05:29.545 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.583 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.609 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.647 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.672 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.711 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.736 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-13T08:05:29.775 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-13T08:05:29.801 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.839 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.864 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.903 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.929 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.967 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-13T08:05:29.992 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T08:05:30.035 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-13T08:05:30.058 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-13T08:05:30.058 DEBUG:teuthology.orchestra.run.trial104:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-13T08:05:30.105 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T08:05:30.171 DEBUG:teuthology.orchestra.run.trial104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-13T08:05:30.222 DEBUG:teuthology.orchestra.run.trial104:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-13T08:05:30.269 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T08:05:30.336 DEBUG:teuthology.orchestra.run.trial104:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-13T08:05:30.386 DEBUG:teuthology.orchestra.run.trial119:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-13T08:05:30.395 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-13T08:05:30.461 DEBUG:teuthology.orchestra.run.trial119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-13T08:05:30.512 DEBUG:teuthology.orchestra.run.trial104:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:30.514 DEBUG:teuthology.orchestra.run.trial119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-13T08:05:30.555 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-13T08:05:30.556 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T08:05:30.556 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T08:05:30.559 INFO:tasks.ceph.mon.a:Started 2026-02-13T08:05:30.559 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-13T08:05:30.560 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-13T08:05:30.562 INFO:tasks.ceph.mon.c:Started 2026-02-13T08:05:30.562 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-13T08:05:30.562 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-13T08:05:30.597 INFO:tasks.ceph.mon.b:Started 2026-02-13T08:05:30.597 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-13T08:05:30.598 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-13T08:05:30.598 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-13T08:05:30.600 INFO:tasks.ceph.mgr.x:Started 2026-02-13T08:05:30.600 DEBUG:tasks.ceph:set 0 configs 2026-02-13T08:05:30.600 DEBUG:teuthology.orchestra.run.trial104:> sudo ceph --cluster ceph config dump 2026-02-13T08:05:30.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 10 monclient: get_monmap_and_config 2026-02-13T08:05:30.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 10 monclient: build_initial_monmap 2026-02-13T08:05:30.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 10 monclient: monmap: 2026-02-13T08:05:30.656 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:30.657 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:30.657 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:30.654053+0000 2026-02-13T08:05:30.657 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:30.654053+0000 2026-02-13T08:05:30.657 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:30.657 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:30.657 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:30.657 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:30.657 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:30.657 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:30.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 1 Processor -- start 2026-02-13T08:05:30.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 1 -- start start 2026-02-13T08:05:30.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 10 monclient: init 2026-02-13T08:05:30.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:30.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:05:30.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 10 monclient(hunting): picked mon.noname-b con 0x7f934013c0c0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:30.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 10 monclient(hunting): picked mon.noname-c con 0x7f934013cba0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:30.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 10 monclient(hunting): picked mon.noname-a con 0x7f9340181f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:30.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934008ee60 con 0x7f9340181f20 2026-02-13T08:05:30.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93400870f0 con 0x7f934013cba0 2026-02-13T08:05:30.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9340087330 con 0x7f934013c0c0 2026-02-13T08:05:30.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:30.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f934498d640 10 monclient(hunting): authenticate will time out at 436.243052s 2026-02-13T08:05:30.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f933e575640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f934013c0c0 0x7f934013c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:46688/0 (socket says 10.20.193.104:46688) 2026-02-13T08:05:30.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:30.648+0000 7f933e575640 1 -- 10.20.193.104:0/1874432228 learned_addr learned my addr 10.20.193.104:0/1874432228 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:33.658 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 10 monclient(hunting): tick 2026-02-13T08:05:33.658 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 1 monclient(hunting): continuing hunt 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 1 -- 10.20.193.104:0/1874432228 >> v1:10.20.193.104:6790/0 conn(0x7f934013c0c0 legacy=0x7f934013c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 1 -- 10.20.193.104:0/1874432228 >> v1:10.20.193.119:6789/0 conn(0x7f934013cba0 legacy=0x7f9340180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 1 -- 10.20.193.104:0/1874432228 >> v1:10.20.193.104:6789/0 conn(0x7f9340181f20 legacy=0x7f93401a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 10 monclient(hunting): picked mon.noname-a con 0x7f931c003810 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 10 monclient(hunting): picked mon.noname-b con 0x7f934013c0c0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 10 monclient(hunting): picked mon.noname-c con 0x7f934013cba0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 1 -- 10.20.193.104:0/1874432228 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9340140150 con 0x7f931c003810 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 1 -- 10.20.193.104:0/1874432228 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931c0694e0 con 0x7f934013cba0 2026-02-13T08:05:33.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 1 -- 10.20.193.104:0/1874432228 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931c06a780 con 0x7f934013c0c0 2026-02-13T08:05:33.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:33.648+0000 7f9327fff640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:35.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 -- 10.20.193.104:0/1874432228 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3194028189 0 0) 0x7f9340140150 con 0x7f931c003810 2026-02-13T08:05:35.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient(hunting): _negotiate 2026-02-13T08:05:35.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:35.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:35.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient(hunting): my global_id is 4098 2026-02-13T08:05:35.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 -- 10.20.193.104:0/1874432228 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f932c003620 con 0x7f931c003810 2026-02-13T08:05:35.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 -- 10.20.193.104:0/1874432228 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857526536 0 0) 0x7f931c06a780 con 0x7f934013c0c0 2026-02-13T08:05:35.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient(hunting): _negotiate 2026-02-13T08:05:35.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:35.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:35.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient(hunting): my global_id is 4103 2026-02-13T08:05:35.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 -- 10.20.193.104:0/1874432228 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9340140150 con 0x7f934013c0c0 2026-02-13T08:05:35.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 -- 10.20.193.104:0/1874432228 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4079217111 0 0) 0x7f932c003620 con 0x7f931c003810 2026-02-13T08:05:35.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 -- 10.20.193.104:0/1874432228 >> v1:10.20.193.104:6790/0 conn(0x7f934013c0c0 legacy=0x7f931c0454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:35.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 -- 10.20.193.104:0/1874432228 >> v1:10.20.193.119:6789/0 conn(0x7f934013cba0 legacy=0x7f931c066cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:35.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient: _finish_hunting 0 2026-02-13T08:05:35.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 monclient: found mon.noname-a 2026-02-13T08:05:35.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:35.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:35.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 -- 10.20.193.104:0/1874432228 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c06ba20 con 0x7f931c003810 2026-02-13T08:05:35.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient: _finish_auth 0 2026-02-13T08:05:35.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient: _check_auth_tickets 2026-02-13T08:05:35.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:35.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 -- 10.20.193.104:0/1874432228 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9334002ec0 con 0x7f931c003810 2026-02-13T08:05:35.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:35.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:35.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient: dump: 2026-02-13T08:05:35.929 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:35.930 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:35.930 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:35.930 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:35.930 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:35.930 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:35.930 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:35.930 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:35.930 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:35.930 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:35.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 5 monclient: authenticate success, global_id 4098 2026-02-13T08:05:35.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:35.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 -- 10.20.193.104:0/1874432228 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9334003100 con 0x7f931c003810 2026-02-13T08:05:35.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:35.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 1 -- 10.20.193.104:0/1874432228 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9334003540 con 0x7f931c003810 2026-02-13T08:05:35.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:35.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:35.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933d573640 10 monclient: dump: 2026-02-13T08:05:35.931 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:35.931 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:35.931 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:35.931 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:35.931 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:35.932 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:35.932 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:35.932 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:35.932 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:35.932 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:35.932 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:35.932 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 4 set_mon_vals no callback set 2026-02-13T08:05:35.932 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient: shutdown 2026-02-13T08:05:35.932 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:35.932 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 -- 10.20.193.104:0/1874432228 >> v1:10.20.193.104:6789/0 conn(0x7f931c003810 legacy=0x7f931c023c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:35.932 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 -- 10.20.193.104:0/1874432228 shutdown_connections 2026-02-13T08:05:35.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 -- 10.20.193.104:0/1874432228 >> 10.20.193.104:0/1874432228 conn(0x7f9340090810 msgr2=0x7f9340090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:35.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 -- 10.20.193.104:0/1874432228 shutdown_connections 2026-02-13T08:05:35.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 -- 10.20.193.104:0/1874432228 wait complete. 2026-02-13T08:05:35.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient: build_initial_monmap 2026-02-13T08:05:35.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient: monmap: 2026-02-13T08:05:35.933 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:35.933 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:35.933 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:35.933 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:35.933 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:35.933 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:35.934 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:35.934 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:35.934 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:35.934 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:35.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 librados: starting msgr at 2026-02-13T08:05:35.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 librados: starting objecter 2026-02-13T08:05:35.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 Processor -- start 2026-02-13T08:05:35.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 -- start start 2026-02-13T08:05:35.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 librados: setting wanted keys 2026-02-13T08:05:35.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 librados: calling monclient init 2026-02-13T08:05:35.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient: init 2026-02-13T08:05:35.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:35.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:35.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient(hunting): picked mon.noname-a con 0x7f931c003810 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:35.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient(hunting): picked mon.noname-b con 0x7f934013c0c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:35.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient(hunting): picked mon.noname-c con 0x7f934013cba0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:35.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934013d300 con 0x7f931c003810 2026-02-13T08:05:35.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934008ab30 con 0x7f934013c0c0 2026-02-13T08:05:35.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f934012cb10 con 0x7f934013cba0 2026-02-13T08:05:35.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:35.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient(hunting): authenticate will time out at 441.506960s 2026-02-13T08:05:35.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933ed76640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f934013cba0 0x7f9340172360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:56978/0 (socket says 10.20.193.104:56978) 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933ed76640 1 -- 10.20.193.104:0/4278258752 learned_addr learned my addr 10.20.193.104:0/4278258752 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933e575640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f931c003810 0x7f934014fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:58396/0 (socket says 10.20.193.104:58396) 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 client.?.objecter ms_handle_connect 0x7f934013cba0 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 client.?.objecter ms_handle_connect 0x7f931c003810 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1572404128 0 0) 0x7f934012cb10 con 0x7f934013cba0 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): my global_id is 4106 2026-02-13T08:05:35.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f930c003620 con 0x7f934013cba0 2026-02-13T08:05:35.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933dd74640 1 -- 10.20.193.104:0/4278258752 >> v1:10.20.193.119:6789/0 conn(0x7f934013c0c0 legacy=0x7f9340170c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2026-02-13T08:05:35.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933dd74640 1 -- 10.20.193.104:0/4278258752 >> v1:10.20.193.119:6789/0 conn(0x7f934013c0c0 legacy=0x7f9340170c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T08:05:35.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933dd74640 1 --1- 10.20.193.104:0/4278258752 >> v1:10.20.193.119:6789/0 conn(0x7f934013c0c0 0x7f9340170c40 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2026-02-13T08:05:35.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f933dd74640 1 --1- 10.20.193.104:0/4278258752 >> v1:10.20.193.119:6789/0 conn(0x7f934013c0c0 0x7f9340170c40 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2026-02-13T08:05:35.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.119:6789/0 2026-02-13T08:05:35.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3502566762 0 0) 0x7f930c003620 con 0x7f934013cba0 2026-02-13T08:05:35.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f934012cb10 con 0x7f934013cba0 2026-02-13T08:05:35.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f93300033b0 con 0x7f934013cba0 2026-02-13T08:05:35.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:35.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:35.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): dump: 2026-02-13T08:05:35.938 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:35.938 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:35.938 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:35.938 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:35.938 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:35.938 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:35.938 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:35.938 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:35.938 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:35.938 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:35.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:35.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1882437751 0 0) 0x7f934013d300 con 0x7f931c003810 2026-02-13T08:05:35.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:35.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:35.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:35.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): my global_id is 4107 2026-02-13T08:05:35.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f930c003620 con 0x7f931c003810 2026-02-13T08:05:35.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1812686106 0 0) 0x7f930c003620 con 0x7f931c003810 2026-02-13T08:05:35.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f934013d300 con 0x7f931c003810 2026-02-13T08:05:35.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9334002dd0 con 0x7f931c003810 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient(hunting): dump: 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:35.940 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:35.941 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:35.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1243994960 0 0) 0x7f934013d300 con 0x7f931c003810 2026-02-13T08:05:35.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 >> v1:10.20.193.104:6790/0 conn(0x7f934013cba0 legacy=0x7f9340172360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:35.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 >> v1:10.20.193.119:6789/0 conn(0x7f934013c0c0 legacy=0x7f9340170c40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:05:35.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:35.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 monclient: found mon.a 2026-02-13T08:05:35.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:35.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93400594b0 con 0x7f931c003810 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient: _finish_auth 0 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f9326ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 5 monclient: authenticate success, global_id 4107 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient: _renew_subs 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 -- 10.20.193.104:0/4278258752 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f934008d620 con 0x7f931c003810 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 client.4107.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient: _renew_subs 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 -- 10.20.193.104:0/4278258752 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f934008cdd0 con 0x7f931c003810 2026-02-13T08:05:35.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.912+0000 7f934498d640 1 librados: init done 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f934498d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f934498d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f934498d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9334003030 con 0x7f931c003810 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f934498d640 1 -- 10.20.193.104:0/4278258752 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9340061860 con 0x7f931c003810 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9334004d30 con 0x7f931c003810 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9327fff640 4 set_mon_vals no callback set 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 10 monclient: dump: 2026-02-13T08:05:35.943 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f93340052e0 con 0x7f931c003810 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 3599500525 0 0) 0x7f9334006890 con 0x7f931c003810 2026-02-13T08:05:35.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 10 client.4107.objecter ms_dispatch2 0x7f9340000ba0 osd_map(1..1 src has 1..1) 2026-02-13T08:05:35.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 3 client.4107.objecter handle_osd_map got epochs [1,1] > 0 2026-02-13T08:05:35.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 3 client.4107.objecter handle_osd_map decoding full epoch 1 2026-02-13T08:05:35.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 20 client.4107.objecter dump_active .. 0 homeless 2026-02-13T08:05:35.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f9334006ba0 con 0x7f931c003810 2026-02-13T08:05:35.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:35.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.916+0000 7f9326ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:35.952 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-13T08:05:35.952 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-13T08:05:35.953 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:35.953 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 1 -- 10.20.193.104:0/4278258752 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "config dump"} v 0) -- 0x7f934013c490 con 0x7f931c003810 2026-02-13T08:05:35.953 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f9326ffd640 1 -- 10.20.193.104:0/4278258752 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (unknown 4069917974 0 2919340917) 0x7f9334006e20 con 0x7f931c003810 2026-02-13T08:05:35.953 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f9326ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-13T08:05:35.953 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f9326ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:35.953 INFO:teuthology.orchestra.run.trial104.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T08:05:35.954 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 10 librados: watch_flush enter 2026-02-13T08:05:35.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 10 librados: watch_flush exit 2026-02-13T08:05:35.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 20 client.4107.objecter shutdown clearing up homeless session... 2026-02-13T08:05:35.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 10 client.4107.objecter successfully canceled tick 2026-02-13T08:05:35.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 10 monclient: shutdown 2026-02-13T08:05:35.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:35.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 1 -- 10.20.193.104:0/4278258752 >> v1:10.20.193.104:6789/0 conn(0x7f931c003810 legacy=0x7f934014fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:35.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 1 -- 10.20.193.104:0/4278258752 shutdown_connections 2026-02-13T08:05:35.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 1 -- 10.20.193.104:0/4278258752 >> 10.20.193.104:0/4278258752 conn(0x7f9340090810 msgr2=0x7f9340057ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:35.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 1 -- 10.20.193.104:0/4278258752 shutdown_connections 2026-02-13T08:05:35.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 1 -- 10.20.193.104:0/4278258752 wait complete. 2026-02-13T08:05:35.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:35.944+0000 7f934498d640 1 librados: shutdown 2026-02-13T08:05:35.962 INFO:tasks.ceph:Setting crush tunables to default 2026-02-13T08:05:35.962 DEBUG:teuthology.orchestra.run.trial104:> sudo ceph --cluster ceph osd crush tunables default 2026-02-13T08:05:36.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: get_monmap_and_config 2026-02-13T08:05:36.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: monmap: 2026-02-13T08:05:36.023 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:36.023 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.024 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:36.020723+0000 2026-02-13T08:05:36.024 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:36.020723+0000 2026-02-13T08:05:36.024 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.024 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:36.024 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.024 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:36.024 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:36.024 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:36.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 Processor -- start 2026-02-13T08:05:36.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- start start 2026-02-13T08:05:36.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: init 2026-02-13T08:05:36.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:36.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient(hunting): picked mon.noname-c con 0x7fc34c08fc20 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient(hunting): picked mon.noname-b con 0x7fc34c13f820 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient(hunting): picked mon.noname-a con 0x7fc34c13fca0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc34c08ecd0 con 0x7fc34c13fca0 2026-02-13T08:05:36.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc34c08e710 con 0x7fc34c08fc20 2026-02-13T08:05:36.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc34c08e9f0 con 0x7fc34c13f820 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient(hunting): authenticate will time out at 441.609724s 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc343fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fc34c13f820 0x7fc34c1806b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:56992/0 (socket says 10.20.193.104:56992) 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc343fff640 1 -- 10.20.193.104:0/1100852450 learned_addr learned my addr 10.20.193.104:0/1100852450 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc343fff640 1 -- 10.20.193.104:0/1100852450 >> v1:10.20.193.104:6790/0 conn(0x7fc34c13f820 legacy=0x7fc34c1806b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send send error: (32) Broken pipe 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc343fff640 1 --1- 10.20.193.104:0/1100852450 >> v1:10.20.193.104:6790/0 conn(0x7fc34c13f820 0x7fc34c1806b0 :-1 s=OPENED pgs=13 cs=1 l=1).write_message error sending 0x7fc34c08e9f0, (32) Broken pipe 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc343fff640 1 --1- 10.20.193.104:0/1100852450 >> v1:10.20.193.104:6790/0 conn(0x7fc34c13f820 0x7fc34c1806b0 :-1 s=OPENED pgs=13 cs=1 l=1).write_event send msg failed 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc343fff640 1 --1- 10.20.193.104:0/1100852450 >> v1:10.20.193.104:6790/0 conn(0x7fc34c13f820 0x7fc34c1806b0 :-1 s=OPENED pgs=13 cs=1 l=1).write_event send msg failed 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc343fff640 1 --1- 10.20.193.104:0/1100852450 >> v1:10.20.193.104:6790/0 conn(0x7fc34c13f820 0x7fc34c1806b0 :-1 s=OPENED pgs=13 cs=1 l=1).fault on lossy channel, failing 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.104:6790/0 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 1 -- 10.20.193.104:0/1100852450 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151444099 0 0) 0x7fc34c08ecd0 con 0x7fc34c13fca0 2026-02-13T08:05:36.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient(hunting): my global_id is 4110 2026-02-13T08:05:36.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 1 -- 10.20.193.104:0/1100852450 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc338003620 con 0x7fc34c13fca0 2026-02-13T08:05:36.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 1 -- 10.20.193.104:0/1100852450 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3418441823 0 0) 0x7fc338003620 con 0x7fc34c13fca0 2026-02-13T08:05:36.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 1 -- 10.20.193.104:0/1100852450 >> v1:10.20.193.104:6790/0 conn(0x7fc34c13f820 legacy=0x7fc34c1806b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:05:36.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 1 -- 10.20.193.104:0/1100852450 >> v1:10.20.193.119:6789/0 conn(0x7fc34c08fc20 legacy=0x7fc34c13f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:05:36.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 1 monclient: found mon.noname-a 2026-02-13T08:05:36.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 1 -- 10.20.193.104:0/1100852450 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34c0521f0 con 0x7fc34c13fca0 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 1 -- 10.20.193.104:0/1100852450 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc348003180 con 0x7fc34c13fca0 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 5 monclient: authenticate success, global_id 4110 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient: dump: 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.035 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.036 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.036 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.036 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:36.036 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.036 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.036 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.036 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:36.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:36.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 1 -- 10.20.193.104:0/1100852450 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc348003400 con 0x7fc34c13fca0 2026-02-13T08:05:36.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 1 -- 10.20.193.104:0/1100852450 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc348003840 con 0x7fc34c13fca0 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 4 set_mon_vals no callback set 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3437fe640 10 monclient: dump: 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:36.037 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.038 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.038 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.038 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:36.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: shutdown 2026-02-13T08:05:36.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- 10.20.193.104:0/1100852450 >> v1:10.20.193.104:6789/0 conn(0x7fc34c13fca0 legacy=0x7fc34c1a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- 10.20.193.104:0/1100852450 shutdown_connections 2026-02-13T08:05:36.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- 10.20.193.104:0/1100852450 >> 10.20.193.104:0/1100852450 conn(0x7fc34c0908f0 msgr2=0x7fc34c051880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- 10.20.193.104:0/1100852450 shutdown_connections 2026-02-13T08:05:36.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- 10.20.193.104:0/1100852450 wait complete. 2026-02-13T08:05:36.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: monmap: 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 librados: starting msgr at 2026-02-13T08:05:36.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 librados: starting objecter 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 Processor -- start 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- start start 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 librados: setting wanted keys 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 librados: calling monclient init 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: init 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient(hunting): picked mon.noname-b con 0x7fc34c13f820 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient(hunting): picked mon.noname-a con 0x7fc34c13fca0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient(hunting): picked mon.noname-c con 0x7fc34c1919f0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc34c12fa10 con 0x7fc34c13fca0 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc34c12cd40 con 0x7fc34c13f820 2026-02-13T08:05:36.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc34c12fcf0 con 0x7fc34c1919f0 2026-02-13T08:05:36.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient(hunting): authenticate will time out at 441.611422s 2026-02-13T08:05:36.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3512e4640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fc34c1919f0 0x7fc34c191e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:56998/0 (socket says 10.20.193.104:56998) 2026-02-13T08:05:36.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc343fff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fc34c13fca0 0x7fc34c12c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:58404/0 (socket says 10.20.193.104:58404) 2026-02-13T08:05:36.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3512e4640 1 -- 10.20.193.104:0/1273387357 learned_addr learned my addr 10.20.193.104:0/1273387357 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:36.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 client.?.objecter ms_handle_connect 0x7fc34c1919f0 2026-02-13T08:05:36.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 client.?.objecter ms_handle_connect 0x7fc34c13fca0 2026-02-13T08:05:36.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236727867 0 0) 0x7fc34c12fa10 con 0x7fc34c13fca0 2026-02-13T08:05:36.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): my global_id is 4113 2026-02-13T08:05:36.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc31c003620 con 0x7fc34c13fca0 2026-02-13T08:05:36.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4204102317 0 0) 0x7fc34c12fcf0 con 0x7fc34c1919f0 2026-02-13T08:05:36.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): my global_id is 4109 2026-02-13T08:05:36.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc34c12fa10 con 0x7fc34c1919f0 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 client.?.objecter ms_handle_connect 0x7fc34c13f820 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 269823306 0 0) 0x7fc31c003620 con 0x7fc34c13fca0 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc34c12fcf0 con 0x7fc34c13fca0 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc334003220 con 0x7fc34c13fca0 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): dump: 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.043 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3267327010 0 0) 0x7fc34c12fa10 con 0x7fc34c1919f0 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc31c003620 con 0x7fc34c1919f0 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc348003090 con 0x7fc34c1919f0 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): dump: 2026-02-13T08:05:36.044 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3287357845 0 0) 0x7fc34c12cd40 con 0x7fc34c13f820 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient(hunting): my global_id is 4108 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc34c12fa10 con 0x7fc34c13f820 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 85681013 0 0) 0x7fc34c12fcf0 con 0x7fc34c13fca0 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 >> v1:10.20.193.104:6790/0 conn(0x7fc34c1919f0 legacy=0x7fc34c191e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 >> v1:10.20.193.119:6789/0 conn(0x7fc34c13f820 legacy=0x7fc34c12bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 monclient: found mon.a 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34c0876a0 con 0x7fc34c13fca0 2026-02-13T08:05:36.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc3417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 5 monclient: authenticate success, global_id 4113 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: _renew_subs 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- 10.20.193.104:0/1273387357 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc34c08a340 con 0x7fc34c13fca0 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 client.4113.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: _renew_subs 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 -- 10.20.193.104:0/1273387357 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc34c12f730 con 0x7fc34c13fca0 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.016+0000 7fc352d6e640 1 librados: init done 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3340033c0 con 0x7fc34c13fca0 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc334004d30 con 0x7fc34c13fca0 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 10 monclient: dump: 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.048 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc342ffd640 4 set_mon_vals no callback set 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7fc3340052e0 con 0x7fc34c13fca0 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (unknown 3599500525 0 0) 0x7fc334006c30 con 0x7fc34c13fca0 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 10 client.4113.objecter ms_dispatch2 0x7fc34c000ba0 osd_map(1..1 src has 1..1) 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 3 client.4113.objecter handle_osd_map got epochs [1,1] > 0 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 3 client.4113.objecter handle_osd_map decoding full epoch 1 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 20 client.4113.objecter dump_active .. 0 homeless 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc352d6e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc352d6e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc352d6e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc352d6e640 1 -- 10.20.193.104:0/1273387357 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc34c1301d0 con 0x7fc34c13fca0 2026-02-13T08:05:36.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7fc3340057e0 con 0x7fc34c13fca0 2026-02-13T08:05:36.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.020+0000 7fc3417fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:36.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.048+0000 7fc352d6e640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-13T08:05:36.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.048+0000 7fc352d6e640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-13T08:05:36.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.048+0000 7fc352d6e640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:36.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.048+0000 7fc352d6e640 1 -- 10.20.193.104:0/1273387357 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fc34c0380f0 con 0x7fc34c13fca0 2026-02-13T08:05:36.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc3417fa640 1 -- 10.20.193.104:0/1273387357 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7fc334005aa0 con 0x7fc34c13fca0 2026-02-13T08:05:36.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc3417fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-13T08:05:36.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc3417fa640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-13T08:05:36.059 INFO:teuthology.orchestra.run.trial104.stderr:adjusted tunables profile to default 2026-02-13T08:05:36.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 10 librados: watch_flush enter 2026-02-13T08:05:36.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 10 librados: watch_flush exit 2026-02-13T08:05:36.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 20 client.4113.objecter shutdown clearing up homeless session... 2026-02-13T08:05:36.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 10 client.4113.objecter successfully canceled tick 2026-02-13T08:05:36.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 10 monclient: shutdown 2026-02-13T08:05:36.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 1 -- 10.20.193.104:0/1273387357 >> v1:10.20.193.104:6789/0 conn(0x7fc34c13fca0 legacy=0x7fc34c12c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 1 -- 10.20.193.104:0/1273387357 shutdown_connections 2026-02-13T08:05:36.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 1 -- 10.20.193.104:0/1273387357 >> 10.20.193.104:0/1273387357 conn(0x7fc34c0908f0 msgr2=0x7fc34c089020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 1 -- 10.20.193.104:0/1273387357 shutdown_connections 2026-02-13T08:05:36.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 1 -- 10.20.193.104:0/1273387357 wait complete. 2026-02-13T08:05:36.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:36.052+0000 7fc352d6e640 1 librados: shutdown 2026-02-13T08:05:36.068 INFO:tasks.ceph:check_enable_crimson: False 2026-02-13T08:05:36.069 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-13T08:05:36.069 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:36.069 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-13T08:05:36.079 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:36.079 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-13T08:05:36.131 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-13T08:05:36.131 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-13T08:05:36.183 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:36.183 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-13T08:05:36.192 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:36.192 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-13T08:05:36.239 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:05:36.239 DEBUG:teuthology.orchestra.run.trial119:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-13T08:05:36.287 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new 460b851b-aaa4-48d1-a60f-7c4d57195f60 0 2026-02-13T08:05:36.385 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: get_monmap_and_config 2026-02-13T08:05:36.385 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.385 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: monmap: 2026-02-13T08:05:36.385 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.385 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.385 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:36.476828+0000 2026-02-13T08:05:36.386 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:36.476828+0000 2026-02-13T08:05:36.386 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.386 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.386 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.386 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:36.386 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:36.386 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.394 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 Processor -- start 2026-02-13T08:05:36.394 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- start start 2026-02-13T08:05:36.394 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: init 2026-02-13T08:05:36.394 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.394 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:36.394 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient(hunting): picked mon.noname-a con 0x7f6838091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.394 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient(hunting): picked mon.noname-b con 0x7f683813f870 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.394 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient(hunting): picked mon.noname-c con 0x7f683813fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.394 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683808e5f0 con 0x7f6838091740 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683808e8d0 con 0x7f683813fcd0 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683808ebb0 con 0x7f683813f870 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient(hunting): authenticate will time out at 445.289851s 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683e70d640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f683813fcd0 0x7f68381a1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41232/0 (socket says 10.20.193.119:41232) 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683e70d640 1 -- 10.20.193.119:0/704054109 learned_addr learned my addr 10.20.193.119:0/704054109 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 816590575 0 0) 0x7f683808e8d0 con 0x7f683813fcd0 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): my global_id is 4111 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6820003620 con 0x7f683813fcd0 2026-02-13T08:05:36.395 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773504122 0 0) 0x7f683808ebb0 con 0x7f683813f870 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): my global_id is 4112 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f683808e8d0 con 0x7f683813f870 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2633097660 0 0) 0x7f683808e5f0 con 0x7f6838091740 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient(hunting): my global_id is 4116 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f683808ebb0 con 0x7f6838091740 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3627682468 0 0) 0x7f6820003620 con 0x7f683813fcd0 2026-02-13T08:05:36.396 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 >> v1:10.20.193.104:6790/0 conn(0x7f683813f870 legacy=0x7f6838180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 >> v1:10.20.193.104:6789/0 conn(0x7f6838091740 legacy=0x7f683813f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 monclient: found mon.noname-c 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6838091b10 con 0x7f683813fcd0 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6834003180 con 0x7f683813fcd0 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.397 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient: dump: 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 5 monclient: authenticate success, global_id 4111 2026-02-13T08:05:36.398 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 <== mon.1 v1:10.20.193.119:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6834003350 con 0x7f683813fcd0 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 1 -- 10.20.193.119:0/704054109 <== mon.1 v1:10.20.193.119:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6834003790 con 0x7f683813fcd0 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683cf0a640 10 monclient: dump: 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.399 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 4 set_mon_vals no callback set 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: shutdown 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- 10.20.193.119:0/704054109 >> v1:10.20.193.119:6789/0 conn(0x7f683813fcd0 legacy=0x7f68381a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- 10.20.193.119:0/704054109 shutdown_connections 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- 10.20.193.119:0/704054109 >> 10.20.193.119:0/704054109 conn(0x7f6838090810 msgr2=0x7f6838090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- 10.20.193.119:0/704054109 shutdown_connections 2026-02-13T08:05:36.400 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- 10.20.193.119:0/704054109 wait complete. 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: monmap: 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:36.401 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 librados: starting msgr at 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 librados: starting objecter 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 Processor -- start 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- start start 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 librados: setting wanted keys 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 librados: calling monclient init 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: init 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient(hunting): picked mon.noname-c con 0x7f6838091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient(hunting): picked mon.noname-a con 0x7f683813f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient(hunting): picked mon.noname-b con 0x7f683813fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.402 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6838058ea0 con 0x7f683813f870 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6838058a20 con 0x7f683813fcd0 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f683812b570 con 0x7f6838091740 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f6840197640 10 monclient(hunting): authenticate will time out at 445.291636s 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683e70d640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f683813fcd0 0x7f68381a16b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41246/0 (socket says 10.20.193.119:41246) 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f683e70d640 1 -- 10.20.193.119:0/390573479 learned_addr learned my addr 10.20.193.119:0/390573479 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f68267fc640 10 client.?.objecter ms_handle_connect 0x7f683813fcd0 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f68267fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1974837982 0 0) 0x7f6838058a20 con 0x7f683813fcd0 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f68267fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f68267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.403 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f68267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f68267fc640 10 monclient(hunting): my global_id is 4114 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6808003620 con 0x7f683813fcd0 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f68267fc640 10 client.?.objecter ms_handle_connect 0x7f6838091740 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.475+0000 7f68267fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 client.?.objecter ms_handle_connect 0x7f683813f870 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1773549214 0 0) 0x7f6808003620 con 0x7f683813fcd0 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6838058a20 con 0x7f683813fcd0 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f68340036a0 con 0x7f683813fcd0 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient(hunting): dump: 2026-02-13T08:05:36.404 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3542642005 0 0) 0x7f683812b570 con 0x7f6838091740 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.405 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient(hunting): my global_id is 4115 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6808003620 con 0x7f6838091740 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2919972326 0 0) 0x7f6838058a20 con 0x7f683813fcd0 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 >> v1:10.20.193.104:6790/0 conn(0x7f6838091740 legacy=0x7f6838127880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 >> v1:10.20.193.104:6789/0 conn(0x7f683813f870 legacy=0x7f6838127f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 monclient: found mon.b 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68381286a0 con 0x7f683813fcd0 2026-02-13T08:05:36.406 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 5 monclient: authenticate success, global_id 4114 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 10 monclient: _renew_subs 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 1 -- 10.20.193.119:0/390573479 --> v1:10.20.193.119:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6838129210 con 0x7f683813fcd0 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 10 client.4114.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 10 monclient: _renew_subs 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 1 -- 10.20.193.119:0/390573479 --> v1:10.20.193.119:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f683812a980 con 0x7f683813fcd0 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 1 librados: init done 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 <== mon.1 v1:10.20.193.119:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6834003350 con 0x7f683813fcd0 2026-02-13T08:05:36.407 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 <== mon.1 v1:10.20.193.119:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f68340050b0 con 0x7f683813fcd0 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6827fff640 4 set_mon_vals no callback set 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient: dump: 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.408 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 <== mon.1 v1:10.20.193.119:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f6834005660 con 0x7f683813fcd0 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 <== mon.1 v1:10.20.193.119:6789/0 8 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (unknown 589309899 0 0) 0x7f6834006ca0 con 0x7f683813fcd0 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 client.4114.objecter ms_dispatch2 0x7f6838000ba0 osd_map(2..2 src has 1..2) 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 3 client.4114.objecter handle_osd_map got epochs [2,2] > 0 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 3 client.4114.objecter handle_osd_map decoding full epoch 2 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 20 client.4114.objecter dump_active .. 0 homeless 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f6840197640 1 -- 10.20.193.119:0/390573479 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6838061860 con 0x7f683813fcd0 2026-02-13T08:05:36.409 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 <== mon.1 v1:10.20.193.119:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f68340059e0 con 0x7f683813fcd0 2026-02-13T08:05:36.410 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.410 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.479+0000 7f68267fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:36.424 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.511+0000 7f6840197640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "460b851b-aaa4-48d1-a60f-7c4d57195f60", "id": 0}] 2026-02-13T08:05:36.424 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.511+0000 7f6840197640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "460b851b-aaa4-48d1-a60f-7c4d57195f60", "id": 0}] 2026-02-13T08:05:36.424 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.511+0000 7f6840197640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.424 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.511+0000 7f6840197640 1 -- 10.20.193.119:0/390573479 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "osd new", "uuid": "460b851b-aaa4-48d1-a60f-7c4d57195f60", "id": 0} v 0) -- 0x7f68381a3590 con 0x7f683813fcd0 2026-02-13T08:05:36.426 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f68267fc640 1 -- 10.20.193.119:0/390573479 <== mon.1 v1:10.20.193.119:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "460b851b-aaa4-48d1-a60f-7c4d57195f60", "id": 0}]=0 v3) ==== 112+0+2 (unknown 3468659092 0 732707515) 0x7f6834005d10 con 0x7f683813fcd0 2026-02-13T08:05:36.426 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f68267fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "460b851b-aaa4-48d1-a60f-7c4d57195f60", "id": 0}] 2026-02-13T08:05:36.426 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f68267fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:36.427 INFO:teuthology.orchestra.run.trial119.stdout:0 2026-02-13T08:05:36.428 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 10 librados: watch_flush enter 2026-02-13T08:05:36.428 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 10 librados: watch_flush exit 2026-02-13T08:05:36.428 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 20 client.4114.objecter shutdown clearing up homeless session... 2026-02-13T08:05:36.428 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 10 client.4114.objecter successfully canceled tick 2026-02-13T08:05:36.428 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 10 monclient: shutdown 2026-02-13T08:05:36.428 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.428 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 1 -- 10.20.193.119:0/390573479 >> v1:10.20.193.119:6789/0 conn(0x7f683813fcd0 legacy=0x7f68381a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.428 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 1 -- 10.20.193.119:0/390573479 shutdown_connections 2026-02-13T08:05:36.428 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 1 -- 10.20.193.119:0/390573479 >> 10.20.193.119:0/390573479 conn(0x7f6838090810 msgr2=0x7f683808cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.428 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 1 -- 10.20.193.119:0/390573479 shutdown_connections 2026-02-13T08:05:36.429 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 1 -- 10.20.193.119:0/390573479 wait complete. 2026-02-13T08:05:36.429 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.515+0000 7f6840197640 1 librados: shutdown 2026-02-13T08:05:36.435 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new b96ae2ae-1756-45e7-932c-2e09b469bbf2 1 2026-02-13T08:05:36.493 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: get_monmap_and_config 2026-02-13T08:05:36.493 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.493 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: monmap: 2026-02-13T08:05:36.493 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.493 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.494 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:36.584997+0000 2026-02-13T08:05:36.494 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:36.584997+0000 2026-02-13T08:05:36.494 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.494 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.494 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.494 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:36.494 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:36.494 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.502 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 Processor -- start 2026-02-13T08:05:36.502 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- start start 2026-02-13T08:05:36.502 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: init 2026-02-13T08:05:36.502 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.502 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:36.502 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient(hunting): picked mon.noname-a con 0x7f3144091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.502 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient(hunting): picked mon.noname-c con 0x7f314413f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.502 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient(hunting): picked mon.noname-b con 0x7f314413fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.502 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314408e5f0 con 0x7f3144091740 2026-02-13T08:05:36.502 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314408e8d0 con 0x7f314413f870 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314408ebb0 con 0x7f314413fcd0 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient(hunting): authenticate will time out at 445.397850s 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3142ffd640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f314413f870 0x7f3144180690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41258/0 (socket says 10.20.193.119:41258) 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3142ffd640 1 -- 10.20.193.119:0/1929606852 learned_addr learned my addr 10.20.193.119:0/1929606852 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567190249 0 0) 0x7f314408e8d0 con 0x7f314413f870 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): my global_id is 4117 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3128003620 con 0x7f314413f870 2026-02-13T08:05:36.503 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2366354382 0 0) 0x7f314408ebb0 con 0x7f314413fcd0 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): my global_id is 4118 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f314408e8d0 con 0x7f314413fcd0 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103179104 0 0) 0x7f314408e5f0 con 0x7f3144091740 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient(hunting): my global_id is 4122 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f314408ebb0 con 0x7f3144091740 2026-02-13T08:05:36.504 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1468456251 0 0) 0x7f3128003620 con 0x7f314413f870 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 >> v1:10.20.193.104:6790/0 conn(0x7f314413fcd0 legacy=0x7f31441a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 >> v1:10.20.193.104:6789/0 conn(0x7f3144091740 legacy=0x7f314413f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 monclient: found mon.noname-c 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3144091b10 con 0x7f314413f870 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3134002e00 con 0x7f314413f870 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.505 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient: dump: 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.506 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 5 monclient: authenticate success, global_id 4117 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 <== mon.1 v1:10.20.193.119:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3134002fd0 con 0x7f314413f870 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 1 -- 10.20.193.119:0/1929606852 <== mon.1 v1:10.20.193.119:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3134003410 con 0x7f314413f870 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31427fc640 10 monclient: dump: 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.507 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 4 set_mon_vals no callback set 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: shutdown 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- 10.20.193.119:0/1929606852 >> v1:10.20.193.119:6789/0 conn(0x7f314413f870 legacy=0x7f3144180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- 10.20.193.119:0/1929606852 shutdown_connections 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- 10.20.193.119:0/1929606852 >> 10.20.193.119:0/1929606852 conn(0x7f3144090810 msgr2=0x7f3144090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.508 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- 10.20.193.119:0/1929606852 shutdown_connections 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- 10.20.193.119:0/1929606852 wait complete. 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: monmap: 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:36.509 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 librados: starting msgr at 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 librados: starting objecter 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 Processor -- start 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- start start 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 librados: setting wanted keys 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 librados: calling monclient init 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: init 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient(hunting): picked mon.noname-b con 0x7f3144091740 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient(hunting): picked mon.noname-c con 0x7f314413f870 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.510 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient(hunting): picked mon.noname-a con 0x7f314413fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314412feb0 con 0x7f314413fcd0 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31440593d0 con 0x7f3144091740 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314408ab30 con 0x7f314413f870 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f3149f18640 10 monclient(hunting): authenticate will time out at 445.399703s 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31437fe640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f3144091740 0x7f314414fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41268/0 (socket says 10.20.193.119:41268) 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f31437fe640 1 -- 10.20.193.119:0/3396399722 learned_addr learned my addr 10.20.193.119:0/3396399722 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f311ffff640 10 client.?.objecter ms_handle_connect 0x7f3144091740 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f311ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054311585 0 0) 0x7f31440593d0 con 0x7f3144091740 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f311ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f311ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.511 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f311ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f311ffff640 10 monclient(hunting): my global_id is 4120 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3114003620 con 0x7f3144091740 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f311ffff640 10 client.?.objecter ms_handle_connect 0x7f314413f870 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.583+0000 7f311ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 client.?.objecter ms_handle_connect 0x7f314413fcd0 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1167541557 0 0) 0x7f314408ab30 con 0x7f314413f870 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): my global_id is 4121 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31440593d0 con 0x7f314413f870 2026-02-13T08:05:36.512 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3981680240 0 0) 0x7f3114003620 con 0x7f3144091740 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f314408ab30 con 0x7f3144091740 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3130003180 con 0x7f3144091740 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): dump: 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.513 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 380366385 0 0) 0x7f314412feb0 con 0x7f314413fcd0 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient(hunting): my global_id is 4125 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3114003620 con 0x7f314413fcd0 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 85027573 0 0) 0x7f314408ab30 con 0x7f3144091740 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 >> v1:10.20.193.104:6790/0 conn(0x7f314413f870 legacy=0x7f3144190ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.514 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 >> v1:10.20.193.104:6789/0 conn(0x7f314413fcd0 legacy=0x7f3144192200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 monclient: found mon.b 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f314413f470 con 0x7f3144091740 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 5 monclient: authenticate success, global_id 4120 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 10 monclient: _renew_subs 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 1 -- 10.20.193.119:0/3396399722 --> v1:10.20.193.119:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f314412fbd0 con 0x7f3144091740 2026-02-13T08:05:36.515 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 10 client.4120.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 10 monclient: _renew_subs 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 1 -- 10.20.193.119:0/3396399722 --> v1:10.20.193.119:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f314412d0f0 con 0x7f3144091740 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 1 librados: init done 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.1 v1:10.20.193.119:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31300039c0 con 0x7f3144091740 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.1 v1:10.20.193.119:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3130003d50 con 0x7f3144091740 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient: dump: 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.516 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3141ffb640 4 set_mon_vals no callback set 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.1 v1:10.20.193.119:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f3130004370 con 0x7f3144091740 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.1 v1:10.20.193.119:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (unknown 3323113152 0 0) 0x7f3130006d10 con 0x7f3144091740 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 client.4120.objecter ms_dispatch2 0x7f3144000ba0 osd_map(3..3 src has 1..3) 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 3 client.4120.objecter handle_osd_map got epochs [3,3] > 0 2026-02-13T08:05:36.517 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 3 client.4120.objecter handle_osd_map decoding full epoch 3 2026-02-13T08:05:36.518 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 20 client.4120.objecter dump_active .. 0 homeless 2026-02-13T08:05:36.518 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.518 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.518 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.518 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f3149f18640 1 -- 10.20.193.119:0/3396399722 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3144061860 con 0x7f3144091740 2026-02-13T08:05:36.518 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.1 v1:10.20.193.119:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f3130006190 con 0x7f3144091740 2026-02-13T08:05:36.518 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.518 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.587+0000 7f311ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:36.532 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.619+0000 7f3149f18640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b96ae2ae-1756-45e7-932c-2e09b469bbf2", "id": 1}] 2026-02-13T08:05:36.532 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.619+0000 7f3149f18640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b96ae2ae-1756-45e7-932c-2e09b469bbf2", "id": 1}] 2026-02-13T08:05:36.532 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.619+0000 7f3149f18640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.532 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.619+0000 7f3149f18640 1 -- 10.20.193.119:0/3396399722 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b96ae2ae-1756-45e7-932c-2e09b469bbf2", "id": 1} v 0) -- 0x7f314412d3e0 con 0x7f3144091740 2026-02-13T08:05:36.534 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f311ffff640 1 -- 10.20.193.119:0/3396399722 <== mon.1 v1:10.20.193.119:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b96ae2ae-1756-45e7-932c-2e09b469bbf2", "id": 1}]=0 v4) ==== 112+0+2 (unknown 2004553520 0 940483276) 0x7f31300058c0 con 0x7f3144091740 2026-02-13T08:05:36.534 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f311ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b96ae2ae-1756-45e7-932c-2e09b469bbf2", "id": 1}] 2026-02-13T08:05:36.534 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f311ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:36.534 INFO:teuthology.orchestra.run.trial119.stdout:1 2026-02-13T08:05:36.535 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 10 librados: watch_flush enter 2026-02-13T08:05:36.535 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 10 librados: watch_flush exit 2026-02-13T08:05:36.536 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 20 client.4120.objecter shutdown clearing up homeless session... 2026-02-13T08:05:36.536 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 10 client.4120.objecter successfully canceled tick 2026-02-13T08:05:36.536 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 10 monclient: shutdown 2026-02-13T08:05:36.536 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.536 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 1 -- 10.20.193.119:0/3396399722 >> v1:10.20.193.119:6789/0 conn(0x7f3144091740 legacy=0x7f314414fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.536 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 1 -- 10.20.193.119:0/3396399722 shutdown_connections 2026-02-13T08:05:36.536 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 1 -- 10.20.193.119:0/3396399722 >> 10.20.193.119:0/3396399722 conn(0x7f3144090810 msgr2=0x7f314408c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.536 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 1 -- 10.20.193.119:0/3396399722 shutdown_connections 2026-02-13T08:05:36.536 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 1 -- 10.20.193.119:0/3396399722 wait complete. 2026-02-13T08:05:36.536 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.623+0000 7f3149f18640 1 librados: shutdown 2026-02-13T08:05:36.543 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new 1ae934c3-1aba-4596-abae-1b7697ebf029 2 2026-02-13T08:05:36.601 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: get_monmap_and_config 2026-02-13T08:05:36.601 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.601 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: monmap: 2026-02-13T08:05:36.602 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.602 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.602 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:36.693144+0000 2026-02-13T08:05:36.602 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:36.693144+0000 2026-02-13T08:05:36.602 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.602 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.602 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.602 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:36.602 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:36.602 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.611 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 Processor -- start 2026-02-13T08:05:36.611 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- start start 2026-02-13T08:05:36.611 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: init 2026-02-13T08:05:36.611 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.611 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:05:36.611 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient(hunting): picked mon.noname-b con 0x7f9960091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.611 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient(hunting): picked mon.noname-c con 0x7f996013f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient(hunting): picked mon.noname-a con 0x7f996013fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996008e5f0 con 0x7f996013fcd0 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996008e8d0 con 0x7f996013f870 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996008ebb0 con 0x7f9960091740 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient(hunting): authenticate will time out at 445.506024s 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9965ce4640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f996013f870 0x7f9960180690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41280/0 (socket says 10.20.193.119:41280) 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9965ce4640 1 -- 10.20.193.119:0/2550402387 learned_addr learned my addr 10.20.193.119:0/2550402387 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 -- 10.20.193.119:0/2550402387 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1363495194 0 0) 0x7f996008e8d0 con 0x7f996013f870 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.612 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient(hunting): my global_id is 4123 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 -- 10.20.193.119:0/2550402387 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9948003620 con 0x7f996013f870 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 -- 10.20.193.119:0/2550402387 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626692699 0 0) 0x7f996008e5f0 con 0x7f996013fcd0 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient(hunting): my global_id is 4128 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 -- 10.20.193.119:0/2550402387 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f996008e8d0 con 0x7f996013fcd0 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 -- 10.20.193.119:0/2550402387 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3158288831 0 0) 0x7f9948003620 con 0x7f996013f870 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 -- 10.20.193.119:0/2550402387 >> v1:10.20.193.104:6790/0 conn(0x7f9960091740 legacy=0x7f996013f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 -- 10.20.193.119:0/2550402387 >> v1:10.20.193.104:6789/0 conn(0x7f996013fcd0 legacy=0x7f99601a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.613 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 monclient: found mon.noname-c 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 -- 10.20.193.119:0/2550402387 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9960091b10 con 0x7f996013f870 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 -- 10.20.193.119:0/2550402387 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9954002e00 con 0x7f996013f870 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient: dump: 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.614 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 5 monclient: authenticate success, global_id 4123 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 -- 10.20.193.119:0/2550402387 <== mon.1 v1:10.20.193.119:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9954003010 con 0x7f996013f870 2026-02-13T08:05:36.615 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 1 -- 10.20.193.119:0/2550402387 <== mon.1 v1:10.20.193.119:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9954003450 con 0x7f996013f870 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f99654e3640 10 monclient: dump: 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.616 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 4 set_mon_vals no callback set 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: shutdown 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- 10.20.193.119:0/2550402387 >> v1:10.20.193.119:6789/0 conn(0x7f996013f870 legacy=0x7f9960180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- 10.20.193.119:0/2550402387 shutdown_connections 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- 10.20.193.119:0/2550402387 >> 10.20.193.119:0/2550402387 conn(0x7f9960090810 msgr2=0x7f9960090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- 10.20.193.119:0/2550402387 shutdown_connections 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- 10.20.193.119:0/2550402387 wait complete. 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.617 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: monmap: 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 librados: starting msgr at 2026-02-13T08:05:36.618 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 librados: starting objecter 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 Processor -- start 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- start start 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 librados: setting wanted keys 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 librados: calling monclient init 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: init 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient(hunting): picked mon.noname-a con 0x7f9960091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient(hunting): picked mon.noname-b con 0x7f996013f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient(hunting): picked mon.noname-c con 0x7f996013fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996012cd30 con 0x7f9960091740 2026-02-13T08:05:36.619 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996012ee70 con 0x7f996013f870 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996012d980 con 0x7f996013fcd0 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.691+0000 7f9968770640 10 monclient(hunting): authenticate will time out at 445.507984s 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9965ce4640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f996013f870 0x7f996012c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41286/0 (socket says 10.20.193.119:41286) 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9965ce4640 1 -- 10.20.193.119:0/191772132 learned_addr learned my addr 10.20.193.119:0/191772132 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 client.?.objecter ms_handle_connect 0x7f996013f870 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087641856 0 0) 0x7f996012ee70 con 0x7f996013f870 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.620 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): my global_id is 4126 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9930003620 con 0x7f996013f870 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 client.?.objecter ms_handle_connect 0x7f9960091740 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 client.?.objecter ms_handle_connect 0x7f996013fcd0 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3262544821 0 0) 0x7f9930003620 con 0x7f996013f870 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f996012ee70 con 0x7f996013f870 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9954003360 con 0x7f996013f870 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): dump: 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.621 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1303054682 0 0) 0x7f996012cd30 con 0x7f9960091740 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.622 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): my global_id is 4131 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9930003620 con 0x7f9960091740 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3330785256 0 0) 0x7f996012d980 con 0x7f996013fcd0 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient(hunting): my global_id is 4127 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f996012cd30 con 0x7f996013fcd0 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2701607710 0 0) 0x7f996012ee70 con 0x7f996013f870 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 >> v1:10.20.193.104:6790/0 conn(0x7f996013fcd0 legacy=0x7f99601917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 >> v1:10.20.193.104:6789/0 conn(0x7f9960091740 legacy=0x7f996012bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.623 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 monclient: found mon.b 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996012f440 con 0x7f996013f870 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 5 monclient: authenticate success, global_id 4126 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 10 monclient: _renew_subs 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 1 -- 10.20.193.119:0/191772132 --> v1:10.20.193.119:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f996012f720 con 0x7f996013f870 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 10 client.4126.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:36.624 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 10 monclient: _renew_subs 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 1 -- 10.20.193.119:0/191772132 --> v1:10.20.193.119:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f996008ab30 con 0x7f996013f870 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 1 librados: init done 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.1 v1:10.20.193.119:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9954002f90 con 0x7f996013f870 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.1 v1:10.20.193.119:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9954004cf0 con 0x7f996013f870 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9964ce2640 4 set_mon_vals no callback set 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient: dump: 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.625 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.1 v1:10.20.193.119:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f99540052a0 con 0x7f996013f870 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.1 v1:10.20.193.119:6789/0 8 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (unknown 1736004630 0 0) 0x7f9954006bc0 con 0x7f996013f870 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 client.4126.objecter ms_dispatch2 0x7f9960000ba0 osd_map(4..4 src has 1..4) 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 3 client.4126.objecter handle_osd_map got epochs [4,4] > 0 2026-02-13T08:05:36.626 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 3 client.4126.objecter handle_osd_map decoding full epoch 4 2026-02-13T08:05:36.627 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 20 client.4126.objecter dump_active .. 0 homeless 2026-02-13T08:05:36.627 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.627 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.627 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.627 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9968770640 1 -- 10.20.193.119:0/191772132 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f996013f620 con 0x7f996013f870 2026-02-13T08:05:36.627 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.1 v1:10.20.193.119:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f9954005fd0 con 0x7f996013f870 2026-02-13T08:05:36.627 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.627 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.695+0000 7f9946ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:36.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.727+0000 7f9968770640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "1ae934c3-1aba-4596-abae-1b7697ebf029", "id": 2}] 2026-02-13T08:05:36.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.727+0000 7f9968770640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "1ae934c3-1aba-4596-abae-1b7697ebf029", "id": 2}] 2026-02-13T08:05:36.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.727+0000 7f9968770640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.639 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.727+0000 7f9968770640 1 -- 10.20.193.119:0/191772132 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "osd new", "uuid": "1ae934c3-1aba-4596-abae-1b7697ebf029", "id": 2} v 0) -- 0x7f99600380f0 con 0x7f996013f870 2026-02-13T08:05:36.641 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9946ffd640 1 -- 10.20.193.119:0/191772132 <== mon.1 v1:10.20.193.119:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ae934c3-1aba-4596-abae-1b7697ebf029", "id": 2}]=0 v5) ==== 112+0+2 (unknown 1861334435 0 216599125) 0x7f9954006870 con 0x7f996013f870 2026-02-13T08:05:36.641 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9946ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "1ae934c3-1aba-4596-abae-1b7697ebf029", "id": 2}] 2026-02-13T08:05:36.641 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9946ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:36.641 INFO:teuthology.orchestra.run.trial119.stdout:2 2026-02-13T08:05:36.642 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 10 librados: watch_flush enter 2026-02-13T08:05:36.642 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 10 librados: watch_flush exit 2026-02-13T08:05:36.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 20 client.4126.objecter shutdown clearing up homeless session... 2026-02-13T08:05:36.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 10 client.4126.objecter successfully canceled tick 2026-02-13T08:05:36.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 10 monclient: shutdown 2026-02-13T08:05:36.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 1 -- 10.20.193.119:0/191772132 >> v1:10.20.193.119:6789/0 conn(0x7f996013f870 legacy=0x7f996012c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 1 -- 10.20.193.119:0/191772132 shutdown_connections 2026-02-13T08:05:36.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 1 -- 10.20.193.119:0/191772132 >> 10.20.193.119:0/191772132 conn(0x7f9960090810 msgr2=0x7f996008c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 1 -- 10.20.193.119:0/191772132 shutdown_connections 2026-02-13T08:05:36.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 1 -- 10.20.193.119:0/191772132 wait complete. 2026-02-13T08:05:36.643 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.731+0000 7f9968770640 1 librados: shutdown 2026-02-13T08:05:36.650 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new 029c49a7-88e6-439c-90f8-534c1b8e4056 3 2026-02-13T08:05:36.709 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient: get_monmap_and_config 2026-02-13T08:05:36.710 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.710 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient: monmap: 2026-02-13T08:05:36.710 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.710 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.710 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:36.801471+0000 2026-02-13T08:05:36.710 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:36.801471+0000 2026-02-13T08:05:36.710 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.711 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.711 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.711 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:36.711 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:36.711 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.720 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 Processor -- start 2026-02-13T08:05:36.720 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 -- start start 2026-02-13T08:05:36.720 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient: init 2026-02-13T08:05:36.720 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.720 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:05:36.720 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient(hunting): picked mon.noname-b con 0x7facdc13f4d0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.720 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient(hunting): picked mon.noname-c con 0x7facdc160160 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.721 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient(hunting): picked mon.noname-a con 0x7facdc181c60 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.721 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc08ef60 con 0x7facdc181c60 2026-02-13T08:05:36.721 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc08aef0 con 0x7facdc160160 2026-02-13T08:05:36.721 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc08b1d0 con 0x7facdc13f4d0 2026-02-13T08:05:36.721 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.721 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient(hunting): authenticate will time out at 445.614275s 2026-02-13T08:05:36.721 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face15c3640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7facdc160160 0x7facdc180540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41288/0 (socket says 10.20.193.119:41288) 2026-02-13T08:05:36.721 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face15c3640 1 -- 10.20.193.119:0/236200645 learned_addr learned my addr 10.20.193.119:0/236200645 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.721 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 1 -- 10.20.193.119:0/236200645 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3145314930 0 0) 0x7facdc08aef0 con 0x7facdc160160 2026-02-13T08:05:36.721 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.722 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.722 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.722 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient(hunting): my global_id is 4129 2026-02-13T08:05:36.722 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 1 -- 10.20.193.119:0/236200645 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facc4003620 con 0x7facdc160160 2026-02-13T08:05:36.722 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 1 -- 10.20.193.119:0/236200645 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2580075728 0 0) 0x7facc4003620 con 0x7facdc160160 2026-02-13T08:05:36.722 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 1 -- 10.20.193.119:0/236200645 >> v1:10.20.193.104:6790/0 conn(0x7facdc13f4d0 legacy=0x7facdc05d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.722 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 1 -- 10.20.193.119:0/236200645 >> v1:10.20.193.104:6789/0 conn(0x7facdc181c60 legacy=0x7facdc1a2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.722 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.722 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 1 monclient: found mon.noname-c 2026-02-13T08:05:36.722 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.722 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.723 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 1 -- 10.20.193.119:0/236200645 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc08ecc0 con 0x7facdc160160 2026-02-13T08:05:36.723 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.723 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.723 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.723 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 1 -- 10.20.193.119:0/236200645 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7facd0002e00 con 0x7facdc160160 2026-02-13T08:05:36.723 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 5 monclient: authenticate success, global_id 4129 2026-02-13T08:05:36.723 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:36.723 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.723 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:36.723 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient: dump: 2026-02-13T08:05:36.723 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.724 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.724 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.724 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.724 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.724 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.724 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.724 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.724 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.724 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.724 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:36.724 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 1 -- 10.20.193.119:0/236200645 <== mon.1 v1:10.20.193.119:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7facd0003010 con 0x7facdc160160 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 1 -- 10.20.193.119:0/236200645 <== mon.1 v1:10.20.193.119:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7facd0003450 con 0x7facdc160160 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face0dc2640 10 monclient: dump: 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.725 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 4 set_mon_vals no callback set 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient: shutdown 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 -- 10.20.193.119:0/236200645 >> v1:10.20.193.119:6789/0 conn(0x7facdc160160 legacy=0x7facdc180540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 -- 10.20.193.119:0/236200645 shutdown_connections 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 -- 10.20.193.119:0/236200645 >> 10.20.193.119:0/236200645 conn(0x7facdc08bf40 msgr2=0x7facdc08c340 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 -- 10.20.193.119:0/236200645 shutdown_connections 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 -- 10.20.193.119:0/236200645 wait complete. 2026-02-13T08:05:36.726 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient: monmap: 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 librados: starting msgr at 2026-02-13T08:05:36.727 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 librados: starting objecter 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 Processor -- start 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 -- start start 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 librados: setting wanted keys 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 1 librados: calling monclient init 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.799+0000 7face2dc6640 10 monclient: init 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient(hunting): picked mon.noname-b con 0x7facdc13f4d0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient(hunting): picked mon.noname-c con 0x7facdc160160 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient(hunting): picked mon.noname-a con 0x7facdc181c60 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc167dd0 con 0x7facdc181c60 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc164ec0 con 0x7facdc13f4d0 2026-02-13T08:05:36.728 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facdc13d690 con 0x7facdc160160 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient(hunting): authenticate will time out at 445.616125s 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face1dc4640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7facdc13f4d0 0x7facdc1640a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41296/0 (socket says 10.20.193.119:41296) 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face1dc4640 1 -- 10.20.193.119:0/4057509634 learned_addr learned my addr 10.20.193.119:0/4057509634 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 client.?.objecter ms_handle_connect 0x7facdc13f4d0 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521879630 0 0) 0x7facdc164ec0 con 0x7facdc13f4d0 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient(hunting): my global_id is 4132 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facac003620 con 0x7facdc13f4d0 2026-02-13T08:05:36.729 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 client.?.objecter ms_handle_connect 0x7facdc181c60 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3806728062 0 0) 0x7facac003620 con 0x7facdc13f4d0 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7facdc164ec0 con 0x7facdc13f4d0 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7faccc0030a0 con 0x7facdc13f4d0 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient(hunting): dump: 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.730 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 client.?.objecter ms_handle_connect 0x7facdc160160 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2263069708 0 0) 0x7facdc164ec0 con 0x7facdc13f4d0 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 >> v1:10.20.193.104:6790/0 conn(0x7facdc160160 legacy=0x7facdc1647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 >> v1:10.20.193.104:6789/0 conn(0x7facdc181c60 legacy=0x7facdc1278f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 monclient: found mon.b 2026-02-13T08:05:36.731 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc0864d0 con 0x7facdc13f4d0 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 5 monclient: authenticate success, global_id 4132 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient: _renew_subs 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 1 -- 10.20.193.119:0/4057509634 --> v1:10.20.193.119:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7facdc166f60 con 0x7facdc13f4d0 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 client.4132.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient: _renew_subs 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.732 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 1 -- 10.20.193.119:0/4057509634 --> v1:10.20.193.119:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7facdc1665d0 con 0x7facdc13f4d0 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 1 librados: init done 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 <== mon.1 v1:10.20.193.119:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faccc003450 con 0x7facdc13f4d0 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 <== mon.1 v1:10.20.193.119:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7faccc003b60 con 0x7facdc13f4d0 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7faccbfff640 4 set_mon_vals no callback set 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient: dump: 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.733 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 <== mon.1 v1:10.20.193.119:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7faccc004140 con 0x7facdc13f4d0 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 <== mon.1 v1:10.20.193.119:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (unknown 1342633583 0 0) 0x7faccc004460 con 0x7facdc13f4d0 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 client.4132.objecter ms_dispatch2 0x7facdc000ba0 osd_map(5..5 src has 1..5) 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 3 client.4132.objecter handle_osd_map got epochs [5,5] > 0 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 3 client.4132.objecter handle_osd_map decoding full epoch 5 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 20 client.4132.objecter dump_active .. 0 homeless 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.734 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.735 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.735 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7face2dc6640 1 -- 10.20.193.119:0/4057509634 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facdc165a70 con 0x7facdc13f4d0 2026-02-13T08:05:36.735 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 <== mon.1 v1:10.20.193.119:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7faccc005d10 con 0x7facdc13f4d0 2026-02-13T08:05:36.735 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.735 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.803+0000 7facca7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:36.746 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.835+0000 7face2dc6640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "029c49a7-88e6-439c-90f8-534c1b8e4056", "id": 3}] 2026-02-13T08:05:36.746 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.835+0000 7face2dc6640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "029c49a7-88e6-439c-90f8-534c1b8e4056", "id": 3}] 2026-02-13T08:05:36.746 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.835+0000 7face2dc6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.746 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.835+0000 7face2dc6640 1 -- 10.20.193.119:0/4057509634 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "osd new", "uuid": "029c49a7-88e6-439c-90f8-534c1b8e4056", "id": 3} v 0) -- 0x7facdc089e70 con 0x7facdc13f4d0 2026-02-13T08:05:36.748 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.835+0000 7facca7fc640 1 -- 10.20.193.119:0/4057509634 <== mon.1 v1:10.20.193.119:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "029c49a7-88e6-439c-90f8-534c1b8e4056", "id": 3}]=0 v6) ==== 112+0+2 (unknown 570502593 0 525046306) 0x7faccc006090 con 0x7facdc13f4d0 2026-02-13T08:05:36.748 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.835+0000 7facca7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "029c49a7-88e6-439c-90f8-534c1b8e4056", "id": 3}] 2026-02-13T08:05:36.748 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.835+0000 7facca7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:36.749 INFO:teuthology.orchestra.run.trial119.stdout:3 2026-02-13T08:05:36.750 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 10 librados: watch_flush enter 2026-02-13T08:05:36.750 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 10 librados: watch_flush exit 2026-02-13T08:05:36.750 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 20 client.4132.objecter shutdown clearing up homeless session... 2026-02-13T08:05:36.750 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 10 client.4132.objecter successfully canceled tick 2026-02-13T08:05:36.750 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 10 monclient: shutdown 2026-02-13T08:05:36.750 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.750 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 1 -- 10.20.193.119:0/4057509634 >> v1:10.20.193.119:6789/0 conn(0x7facdc13f4d0 legacy=0x7facdc1640a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.750 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 1 -- 10.20.193.119:0/4057509634 shutdown_connections 2026-02-13T08:05:36.750 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 1 -- 10.20.193.119:0/4057509634 >> 10.20.193.119:0/4057509634 conn(0x7facdc08bf40 msgr2=0x7facdc088ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.750 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 1 -- 10.20.193.119:0/4057509634 shutdown_connections 2026-02-13T08:05:36.751 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 1 -- 10.20.193.119:0/4057509634 wait complete. 2026-02-13T08:05:36.751 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.839+0000 7face2dc6640 1 librados: shutdown 2026-02-13T08:05:36.758 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new a8122973-739c-4b4b-a9f5-59eac5f15f79 4 2026-02-13T08:05:36.817 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: get_monmap_and_config 2026-02-13T08:05:36.817 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.817 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: monmap: 2026-02-13T08:05:36.817 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.817 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.817 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:36.908661+0000 2026-02-13T08:05:36.817 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:36.908661+0000 2026-02-13T08:05:36.818 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.818 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.818 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.818 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:36.818 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:36.818 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.827 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 Processor -- start 2026-02-13T08:05:36.827 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- start start 2026-02-13T08:05:36.827 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: init 2026-02-13T08:05:36.827 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.827 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:05:36.828 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient(hunting): picked mon.noname-b con 0x7f648c091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.828 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient(hunting): picked mon.noname-c con 0x7f648c13f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.828 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient(hunting): picked mon.noname-a con 0x7f648c13fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.828 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c08e5f0 con 0x7f648c13fcd0 2026-02-13T08:05:36.828 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c08e8d0 con 0x7f648c13f870 2026-02-13T08:05:36.828 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c08ebb0 con 0x7f648c091740 2026-02-13T08:05:36.828 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.828 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient(hunting): authenticate will time out at 445.721619s 2026-02-13T08:05:36.828 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6490ea9640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f648c13f870 0x7f648c180690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41312/0 (socket says 10.20.193.119:41312) 2026-02-13T08:05:36.828 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6490ea9640 1 -- 10.20.193.119:0/927826247 learned_addr learned my addr 10.20.193.119:0/927826247 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.828 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228510149 0 0) 0x7f648c08e8d0 con 0x7f648c13f870 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): my global_id is 4135 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6474003620 con 0x7f648c13f870 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4211066645 0 0) 0x7f648c08ebb0 con 0x7f648c091740 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): my global_id is 4136 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f648c08e8d0 con 0x7f648c091740 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099099013 0 0) 0x7f648c08e5f0 con 0x7f648c13fcd0 2026-02-13T08:05:36.829 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient(hunting): my global_id is 4140 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f648c08ebb0 con 0x7f648c13fcd0 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 695335293 0 0) 0x7f6474003620 con 0x7f648c13f870 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 >> v1:10.20.193.104:6790/0 conn(0x7f648c091740 legacy=0x7f648c13f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 >> v1:10.20.193.104:6789/0 conn(0x7f648c13fcd0 legacy=0x7f648c1a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 monclient: found mon.noname-c 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c091b10 con 0x7f648c13f870 2026-02-13T08:05:36.830 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.831 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.831 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.831 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6480002e00 con 0x7f648c13f870 2026-02-13T08:05:36.831 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 5 monclient: authenticate success, global_id 4135 2026-02-13T08:05:36.831 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:36.831 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.831 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:36.831 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient: dump: 2026-02-13T08:05:36.831 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.832 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.832 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.832 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.832 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.832 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.832 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.833 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.833 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.833 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.833 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:36.833 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 <== mon.1 v1:10.20.193.119:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6480003050 con 0x7f648c13f870 2026-02-13T08:05:36.833 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.834 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 1 -- 10.20.193.119:0/927826247 <== mon.1 v1:10.20.193.119:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6480003490 con 0x7f648c13f870 2026-02-13T08:05:36.834 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.834 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.834 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647bfff640 10 monclient: dump: 2026-02-13T08:05:36.834 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.834 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.834 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.834 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.835 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.835 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.835 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.835 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.835 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.835 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.835 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:36.836 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 4 set_mon_vals no callback set 2026-02-13T08:05:36.836 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: shutdown 2026-02-13T08:05:36.836 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.836 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- 10.20.193.119:0/927826247 >> v1:10.20.193.119:6789/0 conn(0x7f648c13f870 legacy=0x7f648c180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.836 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- 10.20.193.119:0/927826247 shutdown_connections 2026-02-13T08:05:36.836 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- 10.20.193.119:0/927826247 >> 10.20.193.119:0/927826247 conn(0x7f648c090810 msgr2=0x7f648c090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.836 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- 10.20.193.119:0/927826247 shutdown_connections 2026-02-13T08:05:36.836 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- 10.20.193.119:0/927826247 wait complete. 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: monmap: 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:36.837 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 librados: starting msgr at 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 librados: starting objecter 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 Processor -- start 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- start start 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 librados: setting wanted keys 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 librados: calling monclient init 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: init 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient(hunting): picked mon.noname-c con 0x7f648c091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient(hunting): picked mon.noname-b con 0x7f648c13f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient(hunting): picked mon.noname-a con 0x7f648c13fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.838 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c08d930 con 0x7f648c13fcd0 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c12ce70 con 0x7f648c13f870 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c12dad0 con 0x7f648c091740 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient(hunting): authenticate will time out at 445.723467s 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6490ea9640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f648c13f870 0x7f648c12c760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41316/0 (socket says 10.20.193.119:41316) 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6490ea9640 1 -- 10.20.193.119:0/1705602043 learned_addr learned my addr 10.20.193.119:0/1705602043 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 client.?.objecter ms_handle_connect 0x7f648c13f870 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665634585 0 0) 0x7f648c12ce70 con 0x7f648c13f870 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.839 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient(hunting): my global_id is 4138 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f645c003620 con 0x7f648c13f870 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4119287751 0 0) 0x7f645c003620 con 0x7f648c13f870 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f648c12ce70 con 0x7f648c13f870 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 client.?.objecter ms_handle_connect 0x7f648c13fcd0 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f64800033a0 con 0x7f648c13f870 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.840 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1815694365 0 0) 0x7f648c12ce70 con 0x7f648c13f870 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 >> v1:10.20.193.104:6790/0 conn(0x7f648c091740 legacy=0x7f648c12c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 >> v1:10.20.193.104:6789/0 conn(0x7f648c13fcd0 legacy=0x7f648c1919d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.841 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.842 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 monclient: found mon.b 2026-02-13T08:05:36.842 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.842 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.842 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c12f590 con 0x7f648c13f870 2026-02-13T08:05:36.842 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.842 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.842 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.842 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 5 monclient: authenticate success, global_id 4138 2026-02-13T08:05:36.842 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: _renew_subs 2026-02-13T08:05:36.842 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.843 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- 10.20.193.119:0/1705602043 --> v1:10.20.193.119:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f648c12f870 con 0x7f648c13f870 2026-02-13T08:05:36.843 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 client.4138.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:36.843 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: _renew_subs 2026-02-13T08:05:36.843 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.843 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 -- 10.20.193.119:0/1705602043 --> v1:10.20.193.119:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f648c12e890 con 0x7f648c13f870 2026-02-13T08:05:36.843 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6493935640 1 librados: init done 2026-02-13T08:05:36.844 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 <== mon.1 v1:10.20.193.119:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6480004d30 con 0x7f648c13f870 2026-02-13T08:05:36.844 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.844 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 <== mon.1 v1:10.20.193.119:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6480005140 con 0x7f648c13f870 2026-02-13T08:05:36.844 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.844 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.844 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f647b7fe640 4 set_mon_vals no callback set 2026-02-13T08:05:36.844 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 monclient: dump: 2026-02-13T08:05:36.844 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.844 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.844 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.845 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.845 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.845 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.845 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.845 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.845 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.845 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.845 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 <== mon.1 v1:10.20.193.119:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f64800056f0 con 0x7f648c13f870 2026-02-13T08:05:36.845 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 <== mon.1 v1:10.20.193.119:6789/0 8 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (unknown 1024756834 0 0) 0x7f6480006fa0 con 0x7f648c13f870 2026-02-13T08:05:36.845 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 10 client.4138.objecter ms_dispatch2 0x7f648c000ba0 osd_map(6..6 src has 1..6) 2026-02-13T08:05:36.845 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 3 client.4138.objecter handle_osd_map got epochs [6,6] > 0 2026-02-13T08:05:36.846 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.907+0000 7f6479ffb640 3 client.4138.objecter handle_osd_map decoding full epoch 6 2026-02-13T08:05:36.846 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.911+0000 7f6479ffb640 20 client.4138.objecter dump_active .. 0 homeless 2026-02-13T08:05:36.846 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.911+0000 7f6493935640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.846 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.911+0000 7f6493935640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.846 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.911+0000 7f6493935640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.846 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.911+0000 7f6493935640 1 -- 10.20.193.119:0/1705602043 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648c061860 con 0x7f648c13f870 2026-02-13T08:05:36.846 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.911+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 <== mon.1 v1:10.20.193.119:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f6480006b00 con 0x7f648c13f870 2026-02-13T08:05:36.846 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.911+0000 7f6479ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.846 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.911+0000 7f6479ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:36.853 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "a8122973-739c-4b4b-a9f5-59eac5f15f79", "id": 4}] 2026-02-13T08:05:36.853 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "a8122973-739c-4b4b-a9f5-59eac5f15f79", "id": 4}] 2026-02-13T08:05:36.853 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.853 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 1 -- 10.20.193.119:0/1705602043 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "osd new", "uuid": "a8122973-739c-4b4b-a9f5-59eac5f15f79", "id": 4} v 0) -- 0x7f648c12fab0 con 0x7f648c13f870 2026-02-13T08:05:36.855 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6479ffb640 1 -- 10.20.193.119:0/1705602043 <== mon.1 v1:10.20.193.119:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a8122973-739c-4b4b-a9f5-59eac5f15f79", "id": 4}]=0 v7) ==== 112+0+2 (unknown 53977741 0 1697012583) 0x7f6480005c40 con 0x7f648c13f870 2026-02-13T08:05:36.855 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6479ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "a8122973-739c-4b4b-a9f5-59eac5f15f79", "id": 4}] 2026-02-13T08:05:36.856 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6479ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:36.856 INFO:teuthology.orchestra.run.trial119.stdout:4 2026-02-13T08:05:36.857 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 10 librados: watch_flush enter 2026-02-13T08:05:36.857 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 10 librados: watch_flush exit 2026-02-13T08:05:36.857 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 20 client.4138.objecter shutdown clearing up homeless session... 2026-02-13T08:05:36.857 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 10 client.4138.objecter successfully canceled tick 2026-02-13T08:05:36.858 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 10 monclient: shutdown 2026-02-13T08:05:36.858 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.858 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 1 -- 10.20.193.119:0/1705602043 >> v1:10.20.193.119:6789/0 conn(0x7f648c13f870 legacy=0x7f648c12c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.858 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 1 -- 10.20.193.119:0/1705602043 shutdown_connections 2026-02-13T08:05:36.858 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 1 -- 10.20.193.119:0/1705602043 >> 10.20.193.119:0/1705602043 conn(0x7f648c090810 msgr2=0x7f648c08c520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.858 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 1 -- 10.20.193.119:0/1705602043 shutdown_connections 2026-02-13T08:05:36.858 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 1 -- 10.20.193.119:0/1705602043 wait complete. 2026-02-13T08:05:36.858 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:36.943+0000 7f6493935640 1 librados: shutdown 2026-02-13T08:05:36.864 DEBUG:teuthology.orchestra.run.trial119:> sudo ceph --cluster ceph osd new 8901cba8-49ff-4a2a-8f16-6b3db8eff80e 5 2026-02-13T08:05:36.921 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: get_monmap_and_config 2026-02-13T08:05:36.921 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.922 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: monmap: 2026-02-13T08:05:36.922 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.922 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.922 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:37.013138+0000 2026-02-13T08:05:36.922 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:37.013138+0000 2026-02-13T08:05:36.922 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.922 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.922 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.922 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:36.922 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:36.923 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.930 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 Processor -- start 2026-02-13T08:05:36.930 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- start start 2026-02-13T08:05:36.930 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: init 2026-02-13T08:05:36.930 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient(hunting): picked mon.noname-a con 0x7feba8091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient(hunting): picked mon.noname-b con 0x7feba813f870 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient(hunting): picked mon.noname-c con 0x7feba813fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba808e5f0 con 0x7feba8091740 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba808e8d0 con 0x7feba813fcd0 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba808ebb0 con 0x7feba813f870 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient(hunting): authenticate will time out at 445.826091s 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febae92c640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7feba813fcd0 0x7feba81a1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41324/0 (socket says 10.20.193.119:41324) 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febae92c640 1 -- 10.20.193.119:0/662415227 learned_addr learned my addr 10.20.193.119:0/662415227 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.931 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 1 -- 10.20.193.119:0/662415227 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2901169922 0 0) 0x7feba808e8d0 con 0x7feba813fcd0 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient(hunting): my global_id is 4141 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 1 -- 10.20.193.119:0/662415227 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb90003620 con 0x7feba813fcd0 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 1 -- 10.20.193.119:0/662415227 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2356053604 0 0) 0x7feb90003620 con 0x7feba813fcd0 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 1 -- 10.20.193.119:0/662415227 >> v1:10.20.193.104:6790/0 conn(0x7feba813f870 legacy=0x7feba8180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 1 -- 10.20.193.119:0/662415227 >> v1:10.20.193.104:6789/0 conn(0x7feba8091740 legacy=0x7feba813f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 1 monclient: found mon.noname-c 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.932 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 1 -- 10.20.193.119:0/662415227 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba8091b10 con 0x7feba813fcd0 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 5 monclient: authenticate success, global_id 4141 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 1 -- 10.20.193.119:0/662415227 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7feba4003180 con 0x7feba813fcd0 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient: dump: 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.933 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 1 -- 10.20.193.119:0/662415227 <== mon.1 v1:10.20.193.119:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feba4003410 con 0x7feba813fcd0 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 1 -- 10.20.193.119:0/662415227 <== mon.1 v1:10.20.193.119:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7feba4003850 con 0x7feba813fcd0 2026-02-13T08:05:36.934 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febad129640 10 monclient: dump: 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.935 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 4 set_mon_vals no callback set 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: shutdown 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- 10.20.193.119:0/662415227 >> v1:10.20.193.119:6789/0 conn(0x7feba813fcd0 legacy=0x7feba81a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- 10.20.193.119:0/662415227 shutdown_connections 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- 10.20.193.119:0/662415227 >> 10.20.193.119:0/662415227 conn(0x7feba8090810 msgr2=0x7feba8090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- 10.20.193.119:0/662415227 shutdown_connections 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- 10.20.193.119:0/662415227 wait complete. 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: build_initial_monmap 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: monmap: 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:epoch 0 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:36.936 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 0.000000 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr:created 0.000000 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 librados: starting msgr at 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 librados: starting objecter 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 Processor -- start 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- start start 2026-02-13T08:05:36.937 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 librados: setting wanted keys 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 librados: calling monclient init 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: init 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient(hunting): picked mon.noname-c con 0x7feba8091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient(hunting): picked mon.noname-a con 0x7feba813f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient(hunting): picked mon.noname-b con 0x7feba813fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba812ce10 con 0x7feba813f870 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba812efa0 con 0x7feba813fcd0 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feba812dab0 con 0x7feba8091740 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febb03b6640 10 monclient(hunting): authenticate will time out at 445.827671s 2026-02-13T08:05:36.938 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febae92c640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7feba813fcd0 0x7feba81919d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.119:41336/0 (socket says 10.20.193.119:41336) 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7febae92c640 1 -- 10.20.193.119:0/432421357 learned_addr learned my addr 10.20.193.119:0/432421357 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7feb8effd640 10 client.?.objecter ms_handle_connect 0x7feba813fcd0 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7feb8effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272110503 0 0) 0x7feba812efa0 con 0x7feba813fcd0 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7feb8effd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7feb8effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7feb8effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7feb8effd640 10 monclient(hunting): my global_id is 4144 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb78003620 con 0x7feba813fcd0 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7feb8effd640 10 client.?.objecter ms_handle_connect 0x7feba813f870 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.011+0000 7feb8effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 client.?.objecter ms_handle_connect 0x7feba8091740 2026-02-13T08:05:36.939 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609295332 0 0) 0x7feba812ce10 con 0x7feba813f870 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): my global_id is 4149 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feba812efa0 con 0x7feba813f870 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1001198145 0 0) 0x7feb78003620 con 0x7feba813fcd0 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feba812ce10 con 0x7feba813fcd0 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7feba40035c0 con 0x7feba813fcd0 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): dump: 2026-02-13T08:05:36.940 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568509007 0 0) 0x7feba812dab0 con 0x7feba8091740 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:36.941 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient(hunting): my global_id is 4142 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb78003620 con 0x7feba8091740 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3276139855 0 0) 0x7feba812ce10 con 0x7feba813fcd0 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 >> v1:10.20.193.104:6790/0 conn(0x7feba8091740 legacy=0x7feba812bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 >> v1:10.20.193.104:6789/0 conn(0x7feba813f870 legacy=0x7feba812c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 monclient: found mon.b 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feba812fe10 con 0x7feba813fcd0 2026-02-13T08:05:36.942 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient: _finish_auth 0 2026-02-13T08:05:36.943 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:36.943 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:36.943 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 5 monclient: authenticate success, global_id 4144 2026-02-13T08:05:36.943 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 10 monclient: _renew_subs 2026-02-13T08:05:36.943 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.943 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 1 -- 10.20.193.119:0/432421357 --> v1:10.20.193.119:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feba812e870 con 0x7feba813fcd0 2026-02-13T08:05:36.943 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 10 client.4144.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:36.943 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 10 monclient: _renew_subs 2026-02-13T08:05:36.943 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.943 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 1 -- 10.20.193.119:0/432421357 --> v1:10.20.193.119:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feba808ad00 con 0x7feba813fcd0 2026-02-13T08:05:36.944 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 1 librados: init done 2026-02-13T08:05:36.944 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.1 v1:10.20.193.119:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feba4002d10 con 0x7feba813fcd0 2026-02-13T08:05:36.944 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:36.944 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.1 v1:10.20.193.119:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7feba40033b0 con 0x7feba813fcd0 2026-02-13T08:05:36.944 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:36.944 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:36.945 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febac928640 4 set_mon_vals no callback set 2026-02-13T08:05:36.945 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient: dump: 2026-02-13T08:05:36.945 INFO:teuthology.orchestra.run.trial119.stderr:epoch 1 2026-02-13T08:05:36.945 INFO:teuthology.orchestra.run.trial119.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:36.945 INFO:teuthology.orchestra.run.trial119.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.945 INFO:teuthology.orchestra.run.trial119.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:36.945 INFO:teuthology.orchestra.run.trial119.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:36.945 INFO:teuthology.orchestra.run.trial119.stderr:election_strategy: 1 2026-02-13T08:05:36.945 INFO:teuthology.orchestra.run.trial119.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:36.945 INFO:teuthology.orchestra.run.trial119.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:36.945 INFO:teuthology.orchestra.run.trial119.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:36.946 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:05:36.946 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.1 v1:10.20.193.119:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7feba4005540 con 0x7feba813fcd0 2026-02-13T08:05:36.946 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.1 v1:10.20.193.119:6789/0 8 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (unknown 3644067072 0 0) 0x7feba4006ff0 con 0x7feba813fcd0 2026-02-13T08:05:36.946 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 client.4144.objecter ms_dispatch2 0x7feba8000ba0 osd_map(7..7 src has 1..7) 2026-02-13T08:05:36.946 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 3 client.4144.objecter handle_osd_map got epochs [7,7] > 0 2026-02-13T08:05:36.946 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 3 client.4144.objecter handle_osd_map decoding full epoch 7 2026-02-13T08:05:36.946 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 20 client.4144.objecter dump_active .. 0 homeless 2026-02-13T08:05:36.946 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.946 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.947 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.947 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7febb03b6640 1 -- 10.20.193.119:0/432421357 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feba8061860 con 0x7feba813fcd0 2026-02-13T08:05:36.947 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.1 v1:10.20.193.119:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7feba4006a80 con 0x7feba813fcd0 2026-02-13T08:05:36.947 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:36.947 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.015+0000 7feb8effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:36.958 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8901cba8-49ff-4a2a-8f16-6b3db8eff80e", "id": 5}] 2026-02-13T08:05:36.958 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8901cba8-49ff-4a2a-8f16-6b3db8eff80e", "id": 5}] 2026-02-13T08:05:36.958 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:05:36.958 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 1 -- 10.20.193.119:0/432421357 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "osd new", "uuid": "8901cba8-49ff-4a2a-8f16-6b3db8eff80e", "id": 5} v 0) -- 0x7feba80889c0 con 0x7feba813fcd0 2026-02-13T08:05:36.960 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7feb8effd640 1 -- 10.20.193.119:0/432421357 <== mon.1 v1:10.20.193.119:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8901cba8-49ff-4a2a-8f16-6b3db8eff80e", "id": 5}]=0 v8) ==== 112+0+2 (unknown 1284662482 0 1988412176) 0x7feba4006dd0 con 0x7feba813fcd0 2026-02-13T08:05:36.960 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7feb8effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8901cba8-49ff-4a2a-8f16-6b3db8eff80e", "id": 5}] 2026-02-13T08:05:36.960 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7feb8effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:36.960 INFO:teuthology.orchestra.run.trial119.stdout:5 2026-02-13T08:05:36.961 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 10 librados: watch_flush enter 2026-02-13T08:05:36.962 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 10 librados: watch_flush exit 2026-02-13T08:05:36.962 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 20 client.4144.objecter shutdown clearing up homeless session... 2026-02-13T08:05:36.962 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 10 client.4144.objecter successfully canceled tick 2026-02-13T08:05:36.962 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 10 monclient: shutdown 2026-02-13T08:05:36.962 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:36.962 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 1 -- 10.20.193.119:0/432421357 >> v1:10.20.193.119:6789/0 conn(0x7feba813fcd0 legacy=0x7feba81919d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:36.962 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 1 -- 10.20.193.119:0/432421357 shutdown_connections 2026-02-13T08:05:36.962 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 1 -- 10.20.193.119:0/432421357 >> 10.20.193.119:0/432421357 conn(0x7feba8090810 msgr2=0x7feba808c740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:36.962 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 1 -- 10.20.193.119:0/432421357 shutdown_connections 2026-02-13T08:05:36.962 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 1 -- 10.20.193.119:0/432421357 wait complete. 2026-02-13T08:05:36.962 INFO:teuthology.orchestra.run.trial119.stderr:2026-02-13T08:05:37.047+0000 7febb03b6640 1 librados: shutdown 2026-02-13T08:05:36.969 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-13T08:05:36.969 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-13T08:05:36.971 INFO:tasks.ceph.osd.0:Started 2026-02-13T08:05:36.972 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-13T08:05:36.972 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-13T08:05:36.974 INFO:tasks.ceph.osd.1:Started 2026-02-13T08:05:36.975 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-13T08:05:36.975 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-13T08:05:36.977 INFO:tasks.ceph.osd.2:Started 2026-02-13T08:05:36.978 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-13T08:05:36.978 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-13T08:05:36.980 INFO:tasks.ceph.osd.3:Started 2026-02-13T08:05:36.980 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-13T08:05:36.980 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-13T08:05:36.982 INFO:tasks.ceph.osd.4:Started 2026-02-13T08:05:36.982 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-13T08:05:36.983 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-13T08:05:36.985 INFO:tasks.ceph.osd.5:Started 2026-02-13T08:05:36.985 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T08:05:37.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient: get_monmap_and_config 2026-02-13T08:05:37.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient: build_initial_monmap 2026-02-13T08:05:37.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient: monmap: 2026-02-13T08:05:37.052 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:37.052 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:37.052 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:37.041668+0000 2026-02-13T08:05:37.052 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:37.041668+0000 2026-02-13T08:05:37.052 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:37.052 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.052 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:37.053 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:37.053 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:37.053 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:37.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 Processor -- start 2026-02-13T08:05:37.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 -- start start 2026-02-13T08:05:37.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient: init 2026-02-13T08:05:37.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:37.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:37.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient(hunting): picked mon.noname-b con 0x7feb5013c0c0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:37.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient(hunting): picked mon.noname-a con 0x7feb5013cba0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:37.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient(hunting): picked mon.noname-c con 0x7feb50181f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5008ee60 con 0x7feb5013cba0 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb500870f0 con 0x7feb50181f20 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb50087330 con 0x7feb5013c0c0 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient(hunting): authenticate will time out at 442.630392s 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb54f9e640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7feb5013cba0 0x7feb50180800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:58432/0 (socket says 10.20.193.104:58432) 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb54f9e640 1 -- 10.20.193.104:0/2641294868 learned_addr learned my addr 10.20.193.104:0/2641294868 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb5579f640 1 --1- 10.20.193.104:0/2641294868 >> v1:10.20.193.104:6790/0 conn(0x7feb5013c0c0 0x7feb5013c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57040/0 (socket says 10.20.193.104:57040) 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 -- 10.20.193.104:0/2641294868 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3371156585 0 0) 0x7feb5008ee60 con 0x7feb5013cba0 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:37.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient(hunting): my global_id is 4170 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 -- 10.20.193.104:0/2641294868 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb38003620 con 0x7feb5013cba0 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 -- 10.20.193.104:0/2641294868 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339460898 0 0) 0x7feb50087330 con 0x7feb5013c0c0 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient(hunting): my global_id is 4160 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 -- 10.20.193.104:0/2641294868 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb5008ee60 con 0x7feb5013c0c0 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 -- 10.20.193.104:0/2641294868 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3684112266 0 0) 0x7feb38003620 con 0x7feb5013cba0 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 -- 10.20.193.104:0/2641294868 >> v1:10.20.193.104:6790/0 conn(0x7feb5013c0c0 legacy=0x7feb5013c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 -- 10.20.193.104:0/2641294868 >> v1:10.20.193.119:6789/0 conn(0x7feb50181f20 legacy=0x7feb501a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 monclient: found mon.noname-a 2026-02-13T08:05:37.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 -- 10.20.193.104:0/2641294868 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb50140150 con 0x7feb5013cba0 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient: _finish_auth 0 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 -- 10.20.193.104:0/2641294868 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7feb44002e00 con 0x7feb5013cba0 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient: dump: 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.056 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 5 monclient: authenticate success, global_id 4170 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 -- 10.20.193.104:0/2641294868 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb44003040 con 0x7feb5013cba0 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 1 -- 10.20.193.104:0/2641294868 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7feb44003480 con 0x7feb5013cba0 2026-02-13T08:05:37.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb3ffff640 10 monclient: dump: 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:37.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 4 set_mon_vals no callback set 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient: shutdown 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 -- 10.20.193.104:0/2641294868 >> v1:10.20.193.104:6789/0 conn(0x7feb5013cba0 legacy=0x7feb50180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 -- 10.20.193.104:0/2641294868 shutdown_connections 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 -- 10.20.193.104:0/2641294868 >> 10.20.193.104:0/2641294868 conn(0x7feb50090810 msgr2=0x7feb50090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 -- 10.20.193.104:0/2641294868 shutdown_connections 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 -- 10.20.193.104:0/2641294868 wait complete. 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient: build_initial_monmap 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient: monmap: 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:37.059 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 librados: starting msgr at 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 librados: starting objecter 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 Processor -- start 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 -- start start 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 librados: setting wanted keys 2026-02-13T08:05:37.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 1 librados: calling monclient init 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.036+0000 7feb57a2a640 10 monclient: init 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient(hunting): picked mon.noname-a con 0x7feb5013c0c0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient(hunting): picked mon.noname-b con 0x7feb5013cba0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient(hunting): picked mon.noname-c con 0x7feb50181f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5013ddf0 con 0x7feb5013c0c0 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5013d8a0 con 0x7feb5013cba0 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5008ab30 con 0x7feb50181f20 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient(hunting): authenticate will time out at 442.632134s 2026-02-13T08:05:37.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb5579f640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7feb5013c0c0 0x7feb501a21d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:58438/0 (socket says 10.20.193.104:58438) 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb5579f640 1 -- 10.20.193.104:0/1898872073 learned_addr learned my addr 10.20.193.104:0/1898872073 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 client.?.objecter ms_handle_connect 0x7feb5013c0c0 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618314082 0 0) 0x7feb40002a30 con 0x7feb5013c0c0 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): my global_id is 4173 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb20003620 con 0x7feb5013c0c0 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 client.?.objecter ms_handle_connect 0x7feb50181f20 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3639160553 0 0) 0x7feb5008ab30 con 0x7feb50181f20 2026-02-13T08:05:37.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): my global_id is 4163 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb40002a30 con 0x7feb50181f20 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1760819544 0 0) 0x7feb20003620 con 0x7feb5013c0c0 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb5008ab30 con 0x7feb5013c0c0 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7feb400032e0 con 0x7feb5013c0c0 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): dump: 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:37.063 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2077216458 0 0) 0x7feb40002a30 con 0x7feb50181f20 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb20003620 con 0x7feb50181f20 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1709609063 0 0) 0x7feb5008ab30 con 0x7feb5013c0c0 2026-02-13T08:05:37.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 >> v1:10.20.193.104:6790/0 conn(0x7feb50181f20 legacy=0x7feb50181810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 >> v1:10.20.193.119:6789/0 conn(0x7feb5013cba0 legacy=0x7feb501a28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 monclient: found mon.a 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5005a270 con 0x7feb5013c0c0 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 5 monclient: authenticate success, global_id 4173 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient: _renew_subs 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:37.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 1 -- 10.20.193.104:0/1898872073 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb5008d130 con 0x7feb5013c0c0 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 client.4173.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient: _renew_subs 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 1 -- 10.20.193.104:0/1898872073 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7feb501a31c0 con 0x7feb5013c0c0 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 1 librados: init done 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb40004b90 con 0x7feb5013c0c0 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7feb40004ee0 con 0x7feb5013c0c0 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient: dump: 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:37.066 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3f7fe640 4 set_mon_vals no callback set 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7feb40005490 con 0x7feb5013c0c0 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 579353274 0 0) 0x7feb40006120 con 0x7feb5013c0c0 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 client.4173.objecter ms_dispatch2 0x7feb50000ba0 osd_map(8..8 src has 1..8) 2026-02-13T08:05:37.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 3 client.4173.objecter handle_osd_map got epochs [8,8] > 0 2026-02-13T08:05:37.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 3 client.4173.objecter handle_osd_map decoding full epoch 8 2026-02-13T08:05:37.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 20 client.4173.objecter dump_active .. 0 homeless 2026-02-13T08:05:37.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:37.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:37.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:37.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb57a2a640 1 -- 10.20.193.104:0/1898872073 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb50061860 con 0x7feb5013c0c0 2026-02-13T08:05:37.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7feb5013ddf0 con 0x7feb5013c0c0 2026-02-13T08:05:37.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:37.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.040+0000 7feb3dffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:37.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:37.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:37.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:37.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 1 -- 10.20.193.104:0/1898872073 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb501a34b0 con 0x7feb5013c0c0 2026-02-13T08:05:37.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb3dffb640 1 -- 10.20.193.104:0/1898872073 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 3010897726) 0x7feb400068f0 con 0x7feb5013c0c0 2026-02-13T08:05:37.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb3dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:37.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb3dffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:37.079 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:37.079 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":8,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","created":"2026-02-13T08:05:35.908543+0000","modified":"2026-02-13T08:05:36.956118+0000","last_up_change":"0.000000","last_in_change":"2026-02-13T08:05:36.956118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"460b851b-aaa4-48d1-a60f-7c4d57195f60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b96ae2ae-1756-45e7-932c-2e09b469bbf2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ae934c3-1aba-4596-abae-1b7697ebf029","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"029c49a7-88e6-439c-90f8-534c1b8e4056","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a8122973-739c-4b4b-a9f5-59eac5f15f79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8901cba8-49ff-4a2a-8f16-6b3db8eff80e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T08:05:37.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 10 librados: watch_flush enter 2026-02-13T08:05:37.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 10 librados: watch_flush exit 2026-02-13T08:05:37.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 20 client.4173.objecter shutdown clearing up homeless session... 2026-02-13T08:05:37.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 10 client.4173.objecter successfully canceled tick 2026-02-13T08:05:37.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 10 monclient: shutdown 2026-02-13T08:05:37.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:37.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 1 -- 10.20.193.104:0/1898872073 >> v1:10.20.193.104:6789/0 conn(0x7feb5013c0c0 legacy=0x7feb501a21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:37.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.068+0000 7feb57a2a640 1 -- 10.20.193.104:0/1898872073 shutdown_connections 2026-02-13T08:05:37.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.072+0000 7feb57a2a640 1 -- 10.20.193.104:0/1898872073 >> 10.20.193.104:0/1898872073 conn(0x7feb50090810 msgr2=0x7feb5013e040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:37.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.072+0000 7feb57a2a640 1 -- 10.20.193.104:0/1898872073 shutdown_connections 2026-02-13T08:05:37.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.072+0000 7feb57a2a640 1 -- 10.20.193.104:0/1898872073 wait complete. 2026-02-13T08:05:37.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:37.072+0000 7feb57a2a640 1 librados: shutdown 2026-02-13T08:05:37.090 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-13T08:05:37.091 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-13T08:05:37.261 INFO:tasks.ceph.mgr.x.trial119.stderr:ERROR:root:Module 'jmespath' is not installed. 2026-02-13T08:05:37.314 INFO:tasks.ceph.mgr.x.trial119.stderr:ERROR:dashboard.controllers.nvmeof:Failed to import NVMeoFClient and related components: cannot import name 'NVMeoFClient' from 'dashboard.services.nvmeof_client' (/usr/share/ceph/mgr/dashboard/services/nvmeof_client.py) 2026-02-13T08:05:37.319 INFO:tasks.ceph.mgr.x.trial119.stderr:ERROR:sso:Module 'jmespath' is not installed. 2026-02-13T08:05:37.366 INFO:tasks.ceph.mgr.x.trial119.stderr:ERROR:root:Module 'xmltodict' is not installed. 2026-02-13T08:05:37.387 INFO:tasks.ceph.osd.2.trial104.stderr:2026-02-13T08:05:37.380+0000 7fcc902a1a40 -1 Falling back to public interface 2026-02-13T08:05:37.435 INFO:tasks.ceph.osd.1.trial104.stderr:2026-02-13T08:05:37.428+0000 7f883a5b5a40 -1 Falling back to public interface 2026-02-13T08:05:37.443 INFO:tasks.ceph.osd.0.trial104.stderr:2026-02-13T08:05:37.436+0000 7f5586e87a40 -1 Falling back to public interface 2026-02-13T08:05:37.513 INFO:tasks.ceph.osd.3.trial119.stderr:2026-02-13T08:05:37.603+0000 7fa55e09aa40 -1 Falling back to public interface 2026-02-13T08:05:37.533 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-13T08:05:37.623+0000 7f1546ebca40 -1 Falling back to public interface 2026-02-13T08:05:37.549 INFO:tasks.ceph.osd.4.trial119.stderr:2026-02-13T08:05:37.639+0000 7f1a13c08a40 -1 Falling back to public interface 2026-02-13T08:05:37.695 DEBUG:teuthology.orchestra.run.trial104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-13T08:05:37.758 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.740+0000 7f7d7fa33640 10 monclient: get_monmap_and_config 2026-02-13T08:05:37.758 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.740+0000 7f7d7fa33640 10 monclient: build_initial_monmap 2026-02-13T08:05:37.758 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.740+0000 7f7d7fa33640 10 monclient: monmap: 2026-02-13T08:05:37.758 INFO:teuthology.misc.health.trial104.stderr:epoch 0 2026-02-13T08:05:37.758 INFO:teuthology.misc.health.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:37.758 INFO:teuthology.misc.health.trial104.stderr:last_changed 2026-02-13T08:05:37.747387+0000 2026-02-13T08:05:37.758 INFO:teuthology.misc.health.trial104.stderr:created 2026-02-13T08:05:37.747387+0000 2026-02-13T08:05:37.758 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:37.759 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.759 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:37.759 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:37.759 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:37.759 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:37.759 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.740+0000 7f7d7fa33640 1 Processor -- start 2026-02-13T08:05:37.759 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.740+0000 7f7d7fa33640 1 -- start start 2026-02-13T08:05:37.759 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.740+0000 7f7d7fa33640 10 monclient: init 2026-02-13T08:05:37.759 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:37.759 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:37.759 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient(hunting): picked mon.noname-a con 0x7f7d7808d020 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:37.760 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient(hunting): picked mon.noname-b con 0x7f7d78160490 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:37.760 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient(hunting): picked mon.noname-c con 0x7f7d78181f90 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:37.760 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d7808e730 con 0x7f7d7808d020 2026-02-13T08:05:37.760 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d7808f500 con 0x7f7d78181f90 2026-02-13T08:05:37.760 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d7808f7e0 con 0x7f7d78160490 2026-02-13T08:05:37.760 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:37.761 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient(hunting): authenticate will time out at 443.336339s 2026-02-13T08:05:37.761 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7d7a8640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f7d7808d020 0x7f7d7808d3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:58450/0 (socket says 10.20.193.104:58450) 2026-02-13T08:05:37.761 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7d7a8640 1 -- 10.20.193.104:0/1725557576 learned_addr learned my addr 10.20.193.104:0/1725557576 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:37.761 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7cfa7640 1 --1- 10.20.193.104:0/1725557576 >> v1:10.20.193.104:6790/0 conn(0x7f7d78160490 0x7f7d78180870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57052/0 (socket says 10.20.193.104:57052) 2026-02-13T08:05:37.761 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906966363 0 0) 0x7f7d7808f7e0 con 0x7f7d78160490 2026-02-13T08:05:37.761 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:37.761 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:37.761 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:37.761 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): my global_id is 4166 2026-02-13T08:05:37.761 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d60003620 con 0x7f7d78160490 2026-02-13T08:05:37.761 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224772778 0 0) 0x7f7d7808e730 con 0x7f7d7808d020 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): my global_id is 4176 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d7808f7e0 con 0x7f7d7808d020 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600004126 0 0) 0x7f7d7808f500 con 0x7f7d78181f90 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient(hunting): my global_id is 4159 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d7808e730 con 0x7f7d78181f90 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 441244982 0 0) 0x7f7d60003620 con 0x7f7d78160490 2026-02-13T08:05:37.762 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 >> v1:10.20.193.119:6789/0 conn(0x7f7d78181f90 legacy=0x7f7d781a2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 >> v1:10.20.193.104:6789/0 conn(0x7f7d7808d020 legacy=0x7f7d7808d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 monclient: found mon.noname-b 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7808fac0 con 0x7f7d78160490 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient: _finish_auth 0 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7d6c002d30 con 0x7f7d78160490 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:37.763 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient: dump: 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr:epoch 1 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 5 monclient: authenticate success, global_id 4166 2026-02-13T08:05:37.764 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d6c002f00 con 0x7f7d78160490 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 1 -- 10.20.193.104:0/1725557576 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7d6c003340 con 0x7f7d78160490 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d67fff640 10 monclient: dump: 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:epoch 1 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.765 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:37.766 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:37.766 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:37.766 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:37.766 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:37.766 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 4 set_mon_vals no callback set 2026-02-13T08:05:37.766 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: shutdown 2026-02-13T08:05:37.767 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:37.767 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1725557576 >> v1:10.20.193.104:6790/0 conn(0x7f7d78160490 legacy=0x7f7d78180870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:37.767 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1725557576 shutdown_connections 2026-02-13T08:05:37.767 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1725557576 >> 10.20.193.104:0/1725557576 conn(0x7f7d78093f40 msgr2=0x7f7d78090440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:37.767 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1725557576 shutdown_connections 2026-02-13T08:05:37.767 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1725557576 wait complete. 2026-02-13T08:05:37.767 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: build_initial_monmap 2026-02-13T08:05:37.768 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: monmap: 2026-02-13T08:05:37.768 INFO:teuthology.misc.health.trial104.stderr:epoch 0 2026-02-13T08:05:37.768 INFO:teuthology.misc.health.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:37.768 INFO:teuthology.misc.health.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:37.768 INFO:teuthology.misc.health.trial104.stderr:created 0.000000 2026-02-13T08:05:37.768 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:37.769 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.769 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:37.769 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:37.769 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:37.769 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:37.769 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 librados: starting msgr at 2026-02-13T08:05:37.769 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 librados: starting objecter 2026-02-13T08:05:37.769 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 Processor -- start 2026-02-13T08:05:37.770 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- start start 2026-02-13T08:05:37.770 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 librados: setting wanted keys 2026-02-13T08:05:37.770 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 librados: calling monclient init 2026-02-13T08:05:37.770 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: init 2026-02-13T08:05:37.770 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:37.770 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:37.770 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient(hunting): picked mon.noname-c con 0x7f7d7808d020 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:37.771 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient(hunting): picked mon.noname-a con 0x7f7d78160490 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:37.771 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient(hunting): picked mon.noname-b con 0x7f7d78181f90 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:37.771 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d78166160 con 0x7f7d78160490 2026-02-13T08:05:37.771 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d781631b0 con 0x7f7d78181f90 2026-02-13T08:05:37.771 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d7808aac0 con 0x7f7d7808d020 2026-02-13T08:05:37.771 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:37.771 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient(hunting): authenticate will time out at 443.338668s 2026-02-13T08:05:37.771 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7d7a8640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f7d7808d020 0x7f7d78162390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57058/0 (socket says 10.20.193.104:57058) 2026-02-13T08:05:37.771 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7d7a8640 1 -- 10.20.193.104:0/1290822408 learned_addr learned my addr 10.20.193.104:0/1290822408 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:37.771 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7cfa7640 1 --1- 10.20.193.104:0/1290822408 >> v1:10.20.193.104:6789/0 conn(0x7f7d78160490 0x7f7d78162aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:58464/0 (socket says 10.20.193.104:58464) 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 client.?.objecter ms_handle_connect 0x7f7d78160490 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 client.?.objecter ms_handle_connect 0x7f7d7808d020 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 752716148 0 0) 0x7f7d7808aac0 con 0x7f7d7808d020 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): my global_id is 4169 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d48003620 con 0x7f7d7808d020 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748401076 0 0) 0x7f7d78166160 con 0x7f7d78160490 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:37.772 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): my global_id is 4179 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d7808aac0 con 0x7f7d78160490 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 client.?.objecter ms_handle_connect 0x7f7d78181f90 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 217514175 0 0) 0x7f7d7808aac0 con 0x7f7d78160490 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d78166160 con 0x7f7d78160490 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7d6c003250 con 0x7f7d78160490 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:37.773 INFO:teuthology.misc.health.trial104.stderr:epoch 1 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 795543384 0 0) 0x7f7d48003620 con 0x7f7d7808d020 2026-02-13T08:05:37.774 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d7808aac0 con 0x7f7d7808d020 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7d68003100 con 0x7f7d7808d020 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:epoch 1 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:37.775 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3160704885 0 0) 0x7f7d781631b0 con 0x7f7d78181f90 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient(hunting): my global_id is 4162 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d48003620 con 0x7f7d78181f90 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2153373328 0 0) 0x7f7d78166160 con 0x7f7d78160490 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 >> v1:10.20.193.104:6790/0 conn(0x7f7d7808d020 legacy=0x7f7d78162390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 >> v1:10.20.193.119:6789/0 conn(0x7f7d78181f90 legacy=0x7f7d7812bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:37.776 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 monclient: found mon.a 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d78181ce0 con 0x7f7d78160490 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 5 monclient: authenticate success, global_id 4179 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: _renew_subs 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1290822408 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d781652f0 con 0x7f7d78160490 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 client.4179.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:37.777 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: _renew_subs 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d6c004b90 con 0x7f7d78160490 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1290822408 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d78165e80 con 0x7f7d78160490 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 librados: init done 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7d6c004ee0 con 0x7f7d78160490 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 monclient: dump: 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:epoch 1 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.778 INFO:teuthology.misc.health.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d677fe640 4 set_mon_vals no callback set 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 1) ==== 939+0+0 (unknown 246333160 0 0) 0x7f7d6c005490 con 0x7f7d78160490 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (unknown 579353274 0 0) 0x7f7d6c002eb0 con 0x7f7d78160490 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 10 client.4179.objecter ms_dispatch2 0x7f7d78000ba0 osd_map(8..8 src has 1..8) 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 3 client.4179.objecter handle_osd_map got epochs [8,8] > 0 2026-02-13T08:05:37.779 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 3 client.4179.objecter handle_osd_map decoding full epoch 8 2026-02-13T08:05:37.780 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d65ffb640 20 client.4179.objecter dump_active .. 0 homeless 2026-02-13T08:05:37.780 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:37.780 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:37.780 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:37.780 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.744+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1290822408 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d780008e0 con 0x7f7d78160490 2026-02-13T08:05:37.780 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.748+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77519 (unknown 1092875540 0 440498749) 0x7f7d6c0066b0 con 0x7f7d78160490 2026-02-13T08:05:37.780 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.748+0000 7f7d65ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:37.780 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.748+0000 7f7d65ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:37.783 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:37.783 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:37.783 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:37.783 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1290822408 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d78090db0 con 0x7f7d78160490 2026-02-13T08:05:37.784 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d65ffb640 1 -- 10.20.193.104:0/1290822408 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (unknown 150273500 0 3010897726) 0x7f7d6c006910 con 0x7f7d78160490 2026-02-13T08:05:37.784 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d65ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:37.784 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d65ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:37.784 INFO:teuthology.misc.health.trial104.stdout: 2026-02-13T08:05:37.784 INFO:teuthology.misc.health.trial104.stdout:{"epoch":8,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","created":"2026-02-13T08:05:35.908543+0000","modified":"2026-02-13T08:05:36.956118+0000","last_up_change":"0.000000","last_in_change":"2026-02-13T08:05:36.956118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"460b851b-aaa4-48d1-a60f-7c4d57195f60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b96ae2ae-1756-45e7-932c-2e09b469bbf2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1ae934c3-1aba-4596-abae-1b7697ebf029","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"029c49a7-88e6-439c-90f8-534c1b8e4056","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a8122973-739c-4b4b-a9f5-59eac5f15f79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8901cba8-49ff-4a2a-8f16-6b3db8eff80e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T08:05:37.786 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 10 librados: watch_flush enter 2026-02-13T08:05:37.786 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 10 librados: watch_flush exit 2026-02-13T08:05:37.786 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 20 client.4179.objecter shutdown clearing up homeless session... 2026-02-13T08:05:37.786 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 10 client.4179.objecter successfully canceled tick 2026-02-13T08:05:37.786 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 10 monclient: shutdown 2026-02-13T08:05:37.786 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:37.786 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1290822408 >> v1:10.20.193.104:6789/0 conn(0x7f7d78160490 legacy=0x7f7d78162aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:37.786 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1290822408 shutdown_connections 2026-02-13T08:05:37.787 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1290822408 >> 10.20.193.104:0/1290822408 conn(0x7f7d78093f40 msgr2=0x7f7d7805c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:37.787 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1290822408 shutdown_connections 2026-02-13T08:05:37.787 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 1 -- 10.20.193.104:0/1290822408 wait complete. 2026-02-13T08:05:37.787 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:37.776+0000 7f7d7fa33640 1 librados: shutdown 2026-02-13T08:05:37.791 DEBUG:teuthology.misc:0 of 6 OSDs are up 2026-02-13T08:05:37.795 INFO:tasks.ceph.mgr.x.trial119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-13T08:05:37.795 INFO:tasks.ceph.mgr.x.trial119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-13T08:05:37.795 INFO:tasks.ceph.mgr.x.trial119.stderr: from numpy import show_config as show_numpy_config 2026-02-13T08:05:38.551 INFO:tasks.ceph.osd.2.trial104.stderr:2026-02-13T08:05:38.544+0000 7fcc902a1a40 -1 osd.2 0 log_to_monitors true 2026-02-13T08:05:38.610 INFO:tasks.ceph.osd.1.trial104.stderr:2026-02-13T08:05:38.604+0000 7f883a5b5a40 -1 osd.1 0 log_to_monitors true 2026-02-13T08:05:38.639 INFO:tasks.ceph.osd.0.trial104.stderr:2026-02-13T08:05:38.632+0000 7f5586e87a40 -1 osd.0 0 log_to_monitors true 2026-02-13T08:05:38.711 INFO:tasks.ceph.osd.3.trial119.stderr:2026-02-13T08:05:38.799+0000 7fa55e09aa40 -1 osd.3 0 log_to_monitors true 2026-02-13T08:05:38.724 INFO:tasks.ceph.osd.4.trial119.stderr:2026-02-13T08:05:38.811+0000 7f1a13c08a40 -1 osd.4 0 log_to_monitors true 2026-02-13T08:05:38.727 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-13T08:05:38.815+0000 7f1546ebca40 -1 osd.5 0 log_to_monitors true 2026-02-13T08:05:38.874 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-13T08:05:38.963+0000 7fd8295f1640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-13T08:05:38.874 INFO:tasks.ceph.mgr.x.trial119.stderr:2026-02-13T08:05:38.963+0000 7fd8295f1640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-13T08:05:39.926 INFO:tasks.ceph.osd.3.trial119.stderr:2026-02-13T08:05:40.015+0000 7fa559820640 -1 osd.3 0 waiting for initial osdmap 2026-02-13T08:05:39.927 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-13T08:05:40.015+0000 7f1542642640 -1 osd.5 0 waiting for initial osdmap 2026-02-13T08:05:39.927 INFO:tasks.ceph.osd.4.trial119.stderr:2026-02-13T08:05:40.015+0000 7f1a0f38e640 -1 osd.4 0 waiting for initial osdmap 2026-02-13T08:05:39.927 INFO:tasks.ceph.osd.0.trial104.stderr:2026-02-13T08:05:39.920+0000 7f558260d640 -1 osd.0 0 waiting for initial osdmap 2026-02-13T08:05:39.928 INFO:tasks.ceph.osd.2.trial104.stderr:2026-02-13T08:05:39.920+0000 7fcc8ba27640 -1 osd.2 0 waiting for initial osdmap 2026-02-13T08:05:39.928 INFO:tasks.ceph.osd.1.trial104.stderr:2026-02-13T08:05:39.920+0000 7f8835d3b640 -1 osd.1 0 waiting for initial osdmap 2026-02-13T08:05:39.931 INFO:tasks.ceph.osd.0.trial104.stderr:2026-02-13T08:05:39.924+0000 7f557e42e640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T08:05:39.931 INFO:tasks.ceph.osd.2.trial104.stderr:2026-02-13T08:05:39.924+0000 7fcc87848640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T08:05:39.932 INFO:tasks.ceph.osd.1.trial104.stderr:2026-02-13T08:05:39.924+0000 7f8831b5c640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T08:05:39.932 INFO:tasks.ceph.osd.4.trial119.stderr:2026-02-13T08:05:40.019+0000 7f1a071a7640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T08:05:39.932 INFO:tasks.ceph.osd.3.trial119.stderr:2026-02-13T08:05:40.019+0000 7fa555641640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T08:05:39.933 INFO:tasks.ceph.osd.5.trial119.stderr:2026-02-13T08:05:40.019+0000 7f153e463640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T08:05:44.395 DEBUG:teuthology.orchestra.run.trial104:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-13T08:05:44.449 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.440+0000 7f31e7be4640 10 monclient: get_monmap_and_config 2026-02-13T08:05:44.449 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.440+0000 7f31e7be4640 10 monclient: build_initial_monmap 2026-02-13T08:05:44.450 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.440+0000 7f31e7be4640 10 monclient: monmap: 2026-02-13T08:05:44.450 INFO:teuthology.misc.health.trial104.stderr:epoch 0 2026-02-13T08:05:44.450 INFO:teuthology.misc.health.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:44.450 INFO:teuthology.misc.health.trial104.stderr:last_changed 2026-02-13T08:05:44.447074+0000 2026-02-13T08:05:44.450 INFO:teuthology.misc.health.trial104.stderr:created 2026-02-13T08:05:44.447074+0000 2026-02-13T08:05:44.450 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:44.450 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.450 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:44.450 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:44.450 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:44.450 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:44.458 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.440+0000 7f31e7be4640 1 Processor -- start 2026-02-13T08:05:44.458 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.440+0000 7f31e7be4640 1 -- start start 2026-02-13T08:05:44.458 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.440+0000 7f31e7be4640 10 monclient: init 2026-02-13T08:05:44.458 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.440+0000 7f31e7be4640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:44.458 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.440+0000 7f31e7be4640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:44.458 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.440+0000 7f31e7be4640 10 monclient(hunting): picked mon.noname-c con 0x7f31e008d020 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:44.458 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.440+0000 7f31e7be4640 10 monclient(hunting): picked mon.noname-a con 0x7f31e0160490 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:44.458 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient(hunting): picked mon.noname-b con 0x7f31e0181f90 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:44.458 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e008e730 con 0x7f31e0160490 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e008f500 con 0x7f31e008d020 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e008f7e0 con 0x7f31e0181f90 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient(hunting): authenticate will time out at 450.036047s 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e5158640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f31e0160490 0x7f31e0180870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:58516/0 (socket says 10.20.193.104:58516) 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e5158640 1 -- 10.20.193.104:0/3125331239 learned_addr learned my addr 10.20.193.104:0/3125331239 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1084248297 0 0) 0x7f31e008e730 con 0x7f31e0160490 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): my global_id is 4224 2026-02-13T08:05:44.459 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31c8003620 con 0x7f31e0160490 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2263479940 0 0) 0x7f31e008f7e0 con 0x7f31e0181f90 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): my global_id is 4211 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31e008e730 con 0x7f31e0181f90 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609993400 0 0) 0x7f31e008f500 con 0x7f31e008d020 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient(hunting): my global_id is 4210 2026-02-13T08:05:44.460 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31e008f7e0 con 0x7f31e008d020 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2599745829 0 0) 0x7f31e008e730 con 0x7f31e0181f90 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 >> v1:10.20.193.119:6789/0 conn(0x7f31e008d020 legacy=0x7f31e008d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 >> v1:10.20.193.104:6789/0 conn(0x7f31e0160490 legacy=0x7f31e0180870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient: _finish_hunting 0 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 monclient: found mon.noname-b 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e008fac0 con 0x7f31e0181f90 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient: _finish_auth 0 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient: _check_auth_tickets 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:44.461 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f31dc003180 con 0x7f31e0181f90 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient: dump: 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:epoch 1 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:44.462 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 5 monclient: authenticate success, global_id 4211 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31dc003350 con 0x7f31e0181f90 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 1 -- 10.20.193.104:0/3125331239 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f31dc003710 con 0x7f31e0181f90 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 4 set_mon_vals no callback set 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e4957640 10 monclient: dump: 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:epoch 1 2026-02-13T08:05:44.463 INFO:teuthology.misc.health.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: shutdown 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- 10.20.193.104:0/3125331239 >> v1:10.20.193.104:6790/0 conn(0x7f31e0181f90 legacy=0x7f31e01a2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.464 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- 10.20.193.104:0/3125331239 shutdown_connections 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- 10.20.193.104:0/3125331239 >> 10.20.193.104:0/3125331239 conn(0x7f31e0093f40 msgr2=0x7f31e0090440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- 10.20.193.104:0/3125331239 shutdown_connections 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- 10.20.193.104:0/3125331239 wait complete. 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: build_initial_monmap 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: monmap: 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:epoch 0 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:created 0.000000 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.465 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 librados: starting msgr at 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 librados: starting objecter 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 Processor -- start 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- start start 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 librados: setting wanted keys 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 librados: calling monclient init 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: init 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:44.466 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient(hunting): picked mon.noname-c con 0x7f31e008d020 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient(hunting): picked mon.noname-a con 0x7f31e0160490 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient(hunting): picked mon.noname-b con 0x7f31e0181f90 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e008c4b0 con 0x7f31e0160490 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e01564d0 con 0x7f31e0181f90 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e008aac0 con 0x7f31e008d020 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient(hunting): authenticate will time out at 450.038552s 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e5959640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f31e008d020 0x7f31e015f250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57110/0 (socket says 10.20.193.104:57110) 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e5959640 1 -- 10.20.193.104:0/1644875461 learned_addr learned my addr 10.20.193.104:0/1644875461 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 client.?.objecter ms_handle_connect 0x7f31e008d020 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:44.467 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 client.?.objecter ms_handle_connect 0x7f31e0160490 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2345271631 0 0) 0x7f31e008aac0 con 0x7f31e008d020 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): my global_id is 4214 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b0003620 con 0x7f31e008d020 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3874264389 0 0) 0x7f31e008c4b0 con 0x7f31e0160490 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): my global_id is 4227 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31e008aac0 con 0x7f31e0160490 2026-02-13T08:05:44.468 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 client.?.objecter ms_handle_connect 0x7f31e0181f90 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2112842069 0 0) 0x7f31b0003620 con 0x7f31e008d020 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31e008c4b0 con 0x7f31e008d020 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f31d0003180 con 0x7f31e008d020 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): dump: 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:epoch 1 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:44.469 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4180516046 0 0) 0x7f31e01564d0 con 0x7f31e0181f90 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient(hunting): my global_id is 4213 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b0003620 con 0x7f31e0181f90 2026-02-13T08:05:44.470 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2607508760 0 0) 0x7f31e008c4b0 con 0x7f31e008d020 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 >> v1:10.20.193.119:6789/0 conn(0x7f31e0181f90 legacy=0x7f31e012b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 >> v1:10.20.193.104:6789/0 conn(0x7f31e0160490 legacy=0x7f31e0129fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient: _finish_hunting 0 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 monclient: found mon.c 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e005cb00 con 0x7f31e008d020 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient: _finish_auth 0 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient: _check_auth_tickets 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 5 monclient: authenticate success, global_id 4214 2026-02-13T08:05:44.471 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: _renew_subs 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- 10.20.193.104:0/1644875461 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f31e0159ce0 con 0x7f31e008d020 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 client.4214.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: _renew_subs 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- 10.20.193.104:0/1644875461 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f31e005dbb0 con 0x7f31e008d020 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 librados: init done 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31d0003320 con 0x7f31e008d020 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f31d0003b60 con 0x7f31e008d020 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31cffff640 4 set_mon_vals no callback set 2026-02-13T08:05:44.472 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 monclient: dump: 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:epoch 1 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr: 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:44.473 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31e7be4640 1 -- 10.20.193.104:0/1644875461 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e015fa20 con 0x7f31e008d020 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f31d0003d00 con 0x7f31e008d020 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(14..14 src has 1..14) ==== 3147+0+0 (unknown 1941587865 0 0) 0x7f31d004a050 con 0x7f31e008d020 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 10 client.4214.objecter ms_dispatch2 0x7f31e0000ba0 osd_map(14..14 src has 1..14) 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 3 client.4214.objecter handle_osd_map got epochs [14,14] > 0 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 3 client.4214.objecter handle_osd_map decoding full epoch 14 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.444+0000 7f31ce7fc640 20 client.4214.objecter dump_active .. 0 homeless 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.448+0000 7f31e5158640 10 monclient: get_auth_request con 0x7f31b003b720 auth_method 0 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.448+0000 7f31ce7fc640 10 client.4214.objecter ms_handle_connect 0x7f31b003b720 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.448+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f31d0016bd0 con 0x7f31e008d020 2026-02-13T08:05:44.474 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.448+0000 7f31ce7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:44.475 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.448+0000 7f31ce7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:44.540 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:44.540 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:44.540 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.540 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 1 -- 10.20.193.104:0/1644875461 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31e0090db0 con 0x7f31e008d020 2026-02-13T08:05:44.540 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31ce7fc640 1 -- 10.20.193.104:0/1644875461 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8958 (unknown 92231148 0 2938870069) 0x7f31d00164d0 con 0x7f31e008d020 2026-02-13T08:05:44.540 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31ce7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:44.540 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31ce7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:44.541 INFO:teuthology.misc.health.trial104.stdout: 2026-02-13T08:05:44.541 INFO:teuthology.misc.health.trial104.stdout:{"epoch":14,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","created":"2026-02-13T08:05:35.908543+0000","modified":"2026-02-13T08:05:43.935916+0000","last_up_change":"2026-02-13T08:05:40.923658+0000","last_in_change":"2026-02-13T08:05:36.956118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T08:05:41.903600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"460b851b-aaa4-48d1-a60f-7c4d57195f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6808","nonce":1354850314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6809","nonce":1354850314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6811","nonce":1354850314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6810","nonce":1354850314}]},"public_addr":"10.20.193.104:6808/1354850314","cluster_addr":"10.20.193.104:6809/1354850314","heartbeat_back_addr":"10.20.193.104:6811/1354850314","heartbeat_front_addr":"10.20.193.104:6810/1354850314","state":["exists","up"]},{"osd":1,"uuid":"b96ae2ae-1756-45e7-932c-2e09b469bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6804","nonce":3474406264}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6805","nonce":3474406264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6807","nonce":3474406264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6806","nonce":3474406264}]},"public_addr":"10.20.193.104:6804/3474406264","cluster_addr":"10.20.193.104:6805/3474406264","heartbeat_back_addr":"10.20.193.104:6807/3474406264","heartbeat_front_addr":"10.20.193.104:6806/3474406264","state":["exists","up"]},{"osd":2,"uuid":"1ae934c3-1aba-4596-abae-1b7697ebf029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6800","nonce":3938786817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6801","nonce":3938786817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6803","nonce":3938786817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6802","nonce":3938786817}]},"public_addr":"10.20.193.104:6800/3938786817","cluster_addr":"10.20.193.104:6801/3938786817","heartbeat_back_addr":"10.20.193.104:6803/3938786817","heartbeat_front_addr":"10.20.193.104:6802/3938786817","state":["exists","up"]},{"osd":3,"uuid":"029c49a7-88e6-439c-90f8-534c1b8e4056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6800","nonce":4283496532}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6801","nonce":4283496532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6803","nonce":4283496532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6802","nonce":4283496532}]},"public_addr":"10.20.193.119:6800/4283496532","cluster_addr":"10.20.193.119:6801/4283496532","heartbeat_back_addr":"10.20.193.119:6803/4283496532","heartbeat_front_addr":"10.20.193.119:6802/4283496532","state":["exists","up"]},{"osd":4,"uuid":"a8122973-739c-4b4b-a9f5-59eac5f15f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6808","nonce":1543069880}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6809","nonce":1543069880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6811","nonce":1543069880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6810","nonce":1543069880}]},"public_addr":"10.20.193.119:6808/1543069880","cluster_addr":"10.20.193.119:6809/1543069880","heartbeat_back_addr":"10.20.193.119:6811/1543069880","heartbeat_front_addr":"10.20.193.119:6810/1543069880","state":["exists","up"]},{"osd":5,"uuid":"8901cba8-49ff-4a2a-8f16-6b3db8eff80e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6804","nonce":527707922}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6805","nonce":527707922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6807","nonce":527707922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6806","nonce":527707922}]},"public_addr":"10.20.193.119:6804/527707922","cluster_addr":"10.20.193.119:6805/527707922","heartbeat_back_addr":"10.20.193.119:6807/527707922","heartbeat_front_addr":"10.20.193.119:6806/527707922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T08:05:44.542 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 10 librados: watch_flush enter 2026-02-13T08:05:44.542 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 10 librados: watch_flush exit 2026-02-13T08:05:44.542 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 20 client.4214.objecter shutdown clearing up homeless session... 2026-02-13T08:05:44.542 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 10 client.4214.objecter successfully canceled tick 2026-02-13T08:05:44.542 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 1 -- 10.20.193.104:0/1644875461 >> v1:10.20.193.119:6812/276487904 conn(0x7f31b003b720 legacy=0x7f31b005bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.543 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 10 monclient: shutdown 2026-02-13T08:05:44.543 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:44.543 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 1 -- 10.20.193.104:0/1644875461 >> v1:10.20.193.104:6790/0 conn(0x7f31e008d020 legacy=0x7f31e015f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.543 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 1 -- 10.20.193.104:0/1644875461 shutdown_connections 2026-02-13T08:05:44.543 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 1 -- 10.20.193.104:0/1644875461 >> 10.20.193.104:0/1644875461 conn(0x7f31e0093f40 msgr2=0x7f31e008b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:44.543 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 1 -- 10.20.193.104:0/1644875461 shutdown_connections 2026-02-13T08:05:44.543 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 1 -- 10.20.193.104:0/1644875461 wait complete. 2026-02-13T08:05:44.543 INFO:teuthology.misc.health.trial104.stderr:2026-02-13T08:05:44.532+0000 7f31e7be4640 1 librados: shutdown 2026-02-13T08:05:44.549 DEBUG:teuthology.misc:6 of 6 OSDs are up 2026-02-13T08:05:44.550 INFO:tasks.ceph:Creating RBD pool 2026-02-13T08:05:44.550 DEBUG:teuthology.orchestra.run.trial104:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-13T08:05:44.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.600+0000 7f6ad5618640 10 monclient: get_monmap_and_config 2026-02-13T08:05:44.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.600+0000 7f6ad5618640 10 monclient: build_initial_monmap 2026-02-13T08:05:44.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.600+0000 7f6ad5618640 10 monclient: monmap: 2026-02-13T08:05:44.610 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:44.610 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:44.610 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:44.607575+0000 2026-02-13T08:05:44.610 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:44.607575+0000 2026-02-13T08:05:44.610 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:44.610 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.611 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:44.611 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:44.611 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:44.611 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:44.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 Processor -- start 2026-02-13T08:05:44.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- start start 2026-02-13T08:05:44.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: init 2026-02-13T08:05:44.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:44.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:44.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient(hunting): picked mon.noname-c con 0x7f6ad0139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:44.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient(hunting): picked mon.noname-a con 0x7f6ad015e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:44.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient(hunting): picked mon.noname-b con 0x7f6ad017fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad013aa00 con 0x7f6ad015e200 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad008ba20 con 0x7f6ad0139f20 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad0089e30 con 0x7f6ad017fd00 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient(hunting): authenticate will time out at 450.196732s 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acf7fe640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f6ad017fd00 0x7f6ad01a00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57126/0 (socket says 10.20.193.104:57126) 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acf7fe640 1 -- 10.20.193.104:0/3299737397 learned_addr learned my addr 10.20.193.104:0/3299737397 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2489396542 0 0) 0x7f6ad0089e30 con 0x7f6ad017fd00 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): my global_id is 4217 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6abc003620 con 0x7f6ad017fd00 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060000104 0 0) 0x7f6ab8002850 con 0x7f6ad015e200 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): my global_id is 4230 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad0089e30 con 0x7f6ad015e200 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306902290 0 0) 0x7f6ad008ba20 con 0x7f6ad0139f20 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient(hunting): my global_id is 4216 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ab8002850 con 0x7f6ad0139f20 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3378581277 0 0) 0x7f6abc003620 con 0x7f6ad017fd00 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 >> v1:10.20.193.119:6789/0 conn(0x7f6ad0139f20 legacy=0x7f6ad013a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 >> v1:10.20.193.104:6789/0 conn(0x7f6ad015e200 legacy=0x7f6ad017e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 monclient: found mon.noname-b 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad008a380 con 0x7f6ad017fd00 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:44.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6ac0003180 con 0x7f6ad017fd00 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient: dump: 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:44.623 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 5 monclient: authenticate success, global_id 4217 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ac0003320 con 0x7f6ad017fd00 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 1 -- 10.20.193.104:0/3299737397 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6ac0003760 con 0x7f6ad017fd00 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acdffb640 10 monclient: dump: 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.624 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 4 set_mon_vals no callback set 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: shutdown 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- 10.20.193.104:0/3299737397 >> v1:10.20.193.104:6790/0 conn(0x7f6ad017fd00 legacy=0x7f6ad01a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- 10.20.193.104:0/3299737397 shutdown_connections 2026-02-13T08:05:44.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- 10.20.193.104:0/3299737397 >> 10.20.193.104:0/3299737397 conn(0x7f6ad0051a50 msgr2=0x7f6ad0051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- 10.20.193.104:0/3299737397 shutdown_connections 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- 10.20.193.104:0/3299737397 wait complete. 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: build_initial_monmap 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: monmap: 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:44.626 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 librados: starting msgr at 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 librados: starting objecter 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 Processor -- start 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- start start 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 librados: setting wanted keys 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 librados: calling monclient init 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: init 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:44.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient(hunting): picked mon.noname-b con 0x7f6ad0139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient(hunting): picked mon.noname-a con 0x7f6ad015e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient(hunting): picked mon.noname-c con 0x7f6ad017fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad017ed20 con 0x7f6ad015e200 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad0086620 con 0x7f6ad0139f20 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ad0164010 con 0x7f6ad017fd00 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient(hunting): authenticate will time out at 450.199246s 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ace7fc640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f6ad015e200 0x7f6ad017e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:58534/0 (socket says 10.20.193.104:58534) 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acf7fe640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f6ad017fd00 0x7f6ad0127ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57136/0 (socket says 10.20.193.104:57136) 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ace7fc640 1 -- 10.20.193.104:0/4239868644 learned_addr learned my addr 10.20.193.104:0/4239868644 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 client.?.objecter ms_handle_connect 0x7f6ad015e200 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:44.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 client.?.objecter ms_handle_connect 0x7f6ad017fd00 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299113641 0 0) 0x7f6ad0164010 con 0x7f6ad017fd00 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): my global_id is 4220 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a9c003620 con 0x7f6ad017fd00 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 client.?.objecter ms_handle_connect 0x7f6ad0139f20 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2464009233 0 0) 0x7f6ad017ed20 con 0x7f6ad015e200 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): my global_id is 4233 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad0164010 con 0x7f6ad015e200 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625976284 0 0) 0x7f6ad0086620 con 0x7f6ad0139f20 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): my global_id is 4219 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ad017ed20 con 0x7f6ad0139f20 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3346022987 0 0) 0x7f6a9c003620 con 0x7f6ad017fd00 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ad0086620 con 0x7f6ad017fd00 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2966861428 0 0) 0x7f6ad0164010 con 0x7f6ad015e200 2026-02-13T08:05:44.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a9c003620 con 0x7f6ad015e200 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6ac0003670 con 0x7f6ad017fd00 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:44.631 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6ab8003250 con 0x7f6ad015e200 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.632 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:44.633 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:44.633 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:44.633 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:44.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 636984050 0 0) 0x7f6ad0086620 con 0x7f6ad017fd00 2026-02-13T08:05:44.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 >> v1:10.20.193.119:6789/0 conn(0x7f6ad0139f20 legacy=0x7f6ad017df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 >> v1:10.20.193.104:6789/0 conn(0x7f6ad015e200 legacy=0x7f6ad017e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:44.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:44.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 monclient: found mon.c 2026-02-13T08:05:44.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:44.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad0162b20 con 0x7f6ad017fd00 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 5 monclient: authenticate success, global_id 4220 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: _renew_subs 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- 10.20.193.104:0/4239868644 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad0164e80 con 0x7f6ad017fd00 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 client.4220.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: _renew_subs 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 -- 10.20.193.104:0/4239868644 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ad01638e0 con 0x7f6ad017fd00 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6ad5618640 1 librados: init done 2026-02-13T08:05:44.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ac00032c0 con 0x7f6ad017fd00 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6ac00050b0 con 0x7f6ad017fd00 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6aaf7fe640 10 monclient: dump: 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:44.635 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.604+0000 7f6acd7fa640 4 set_mon_vals no callback set 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f6ac00110c0 con 0x7f6ad017fd00 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6ad5618640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6ad5618640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6ad5618640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6ad5618640 1 -- 10.20.193.104:0/4239868644 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad0061860 con 0x7f6ad017fd00 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(14..14 src has 1..14) ==== 3147+0+0 (unknown 1941587865 0 0) 0x7f6ac004a2a0 con 0x7f6ad017fd00 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6aaf7fe640 10 client.4220.objecter ms_dispatch2 0x7f6ad0000ba0 osd_map(14..14 src has 1..14) 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6aaf7fe640 3 client.4220.objecter handle_osd_map got epochs [14,14] > 0 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6aaf7fe640 3 client.4220.objecter handle_osd_map decoding full epoch 14 2026-02-13T08:05:44.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6aaf7fe640 20 client.4220.objecter dump_active .. 0 homeless 2026-02-13T08:05:44.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6aceffd640 10 monclient: get_auth_request con 0x7f6a9c03b890 auth_method 0 2026-02-13T08:05:44.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6aaf7fe640 10 client.4220.objecter ms_handle_connect 0x7f6a9c03b890 2026-02-13T08:05:44.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f6ac0016e80 con 0x7f6ad017fd00 2026-02-13T08:05:44.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6aaf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:44.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.608+0000 7f6aaf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:44.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.696+0000 7f6ad5618640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-13T08:05:44.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.696+0000 7f6ad5618640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-13T08:05:44.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.696+0000 7f6ad5618640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:44.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:44.696+0000 7f6ad5618640 1 -- 10.20.193.104:0/4239868644 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f6ad0088e20 con 0x7f6ad017fd00 2026-02-13T08:05:45.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6aaf7fe640 1 -- 10.20.193.104:0/4239868644 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (unknown 1237045831 0 0) 0x7f6ac0016780 con 0x7f6ad017fd00 2026-02-13T08:05:45.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6aaf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-13T08:05:45.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6aaf7fe640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-13T08:05:45.235 INFO:teuthology.orchestra.run.trial104.stderr:pool 'rbd' created 2026-02-13T08:05:45.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 10 librados: watch_flush enter 2026-02-13T08:05:45.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 10 librados: watch_flush exit 2026-02-13T08:05:45.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 20 client.4220.objecter shutdown clearing up homeless session... 2026-02-13T08:05:45.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 10 client.4220.objecter successfully canceled tick 2026-02-13T08:05:45.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 1 -- 10.20.193.104:0/4239868644 >> v1:10.20.193.119:6812/276487904 conn(0x7f6a9c03b890 legacy=0x7f6a9c05bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:45.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 10 monclient: shutdown 2026-02-13T08:05:45.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:45.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 1 -- 10.20.193.104:0/4239868644 >> v1:10.20.193.104:6790/0 conn(0x7f6ad017fd00 legacy=0x7f6ad0127ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:45.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 1 -- 10.20.193.104:0/4239868644 shutdown_connections 2026-02-13T08:05:45.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 1 -- 10.20.193.104:0/4239868644 >> 10.20.193.104:0/4239868644 conn(0x7f6ad0051a50 msgr2=0x7f6ad005bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:45.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 1 -- 10.20.193.104:0/4239868644 shutdown_connections 2026-02-13T08:05:45.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 1 -- 10.20.193.104:0/4239868644 wait complete. 2026-02-13T08:05:45.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.228+0000 7f6ad5618640 1 librados: shutdown 2026-02-13T08:05:45.248 DEBUG:teuthology.orchestra.run.trial104:> rbd --cluster ceph pool init rbd 2026-02-13T08:05:45.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.256+0000 7f1ab848e200 10 monclient: get_monmap_and_config 2026-02-13T08:05:45.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.256+0000 7f1ab848e200 10 monclient: build_initial_monmap 2026-02-13T08:05:45.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.256+0000 7f1ab848e200 10 monclient: monmap: 2026-02-13T08:05:45.266 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:45.266 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:45.266 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:45.263379+0000 2026-02-13T08:05:45.266 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:45.263379+0000 2026-02-13T08:05:45.266 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:45.266 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:45.266 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:45.267 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:45.267 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:45.267 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:45.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.256+0000 7f1ab848e200 1 Processor -- start 2026-02-13T08:05:45.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.256+0000 7f1ab848e200 1 -- start start 2026-02-13T08:05:45.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.256+0000 7f1ab848e200 10 monclient: init 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: _reopen_session rank -1 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient(hunting): picked mon.noname-c con 0x55b6d47a1520 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient(hunting): picked mon.noname-b con 0x55b6d479b6f0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient(hunting): picked mon.noname-a con 0x55b6d479bb50 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55b6d4615630 con 0x55b6d479bb50 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55b6d46134d0 con 0x55b6d47a1520 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55b6d45dba10 con 0x55b6d479b6f0 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient(hunting): _renew_subs 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient(hunting): authenticate will time out at 450.852238s 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab81eb640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x55b6d479bb50 0x55b6d48b6830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:58540/0 (socket says 10.20.193.104:58540) 2026-02-13T08:05:45.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab6761640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x55b6d479b6f0 0x55b6d4895100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57142/0 (socket says 10.20.193.104:57142) 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab81eb640 1 -- 10.20.193.104:0/3902755489 learned_addr learned my addr 10.20.193.104:0/3902755489 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1319687149 0 0) 0x55b6d45dba10 con 0x55b6d479b6f0 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): _negotiate 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): my global_id is 4223 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1aa4001e20 con 0x55b6d479b6f0 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874572551 0 0) 0x55b6d4615630 con 0x55b6d479bb50 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): _negotiate 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:45.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): my global_id is 4236 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55b6d45dba10 con 0x55b6d479bb50 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755581646 0 0) 0x55b6d46134d0 con 0x55b6d47a1520 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): _negotiate 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient(hunting): my global_id is 4222 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55b6d4615630 con 0x55b6d47a1520 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1803756044 0 0) 0x7f1aa4001e20 con 0x55b6d479b6f0 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 >> v1:10.20.193.119:6789/0 conn(0x55b6d47a1520 legacy=0x55b6d4853d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 >> v1:10.20.193.104:6789/0 conn(0x55b6d479bb50 legacy=0x55b6d48b6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient: _finish_hunting 0 2026-02-13T08:05:45.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 monclient: found mon.noname-b 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d45eb850 con 0x55b6d479b6f0 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient: _finish_auth 0 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient: _check_auth_tickets 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1aa0001600 con 0x55b6d479b6f0 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient: dump: 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:45.279 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 5 monclient: authenticate success, global_id 4223 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1aa0001810 con 0x55b6d479b6f0 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: get_monmap_and_config success 2026-02-13T08:05:45.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 4 set_mon_vals no callback set 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 1 -- 10.20.193.104:0/3902755489 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1aa0001c50 con 0x55b6d479b6f0 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab5f60640 10 monclient: dump: 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:45.281 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: shutdown 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- 10.20.193.104:0/3902755489 >> v1:10.20.193.104:6790/0 conn(0x55b6d479b6f0 legacy=0x55b6d4895100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- 10.20.193.104:0/3902755489 shutdown_connections 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- 10.20.193.104:0/3902755489 >> 10.20.193.104:0/3902755489 conn(0x55b6d4783a20 msgr2=0x55b6d47a2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- 10.20.193.104:0/3902755489 shutdown_connections 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- 10.20.193.104:0/3902755489 wait complete. 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: build_initial_monmap 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: monmap: 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:45.282 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 librados: starting msgr at 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 librados: starting objecter 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 Processor -- start 2026-02-13T08:05:45.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- start start 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 librados: setting wanted keys 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 librados: calling monclient init 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: init 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: _reopen_session rank -1 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient(hunting): picked mon.noname-b con 0x55b6d479b6f0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient(hunting): picked mon.noname-a con 0x55b6d479bb50 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient(hunting): picked mon.noname-c con 0x55b6d47a1520 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55b6d481fbe0 con 0x55b6d479bb50 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55b6d479c1a0 con 0x55b6d479b6f0 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55b6d481fec0 con 0x55b6d47a1520 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient(hunting): _renew_subs 2026-02-13T08:05:45.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient(hunting): authenticate will time out at 450.854109s 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab81eb640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x55b6d47a1520 0x55b6d48424c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57148/0 (socket says 10.20.193.104:57148) 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab81eb640 1 -- 10.20.193.104:0/1389455400 learned_addr learned my addr 10.20.193.104:0/1389455400 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 client.?.objecter ms_handle_connect 0x55b6d47a1520 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 client.?.objecter ms_handle_connect 0x55b6d479bb50 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2072257980 0 0) 0x55b6d481fec0 con 0x55b6d47a1520 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): my global_id is 4226 2026-02-13T08:05:45.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a98001e20 con 0x55b6d47a1520 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 client.?.objecter ms_handle_connect 0x55b6d479b6f0 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360696694 0 0) 0x55b6d481fbe0 con 0x55b6d479bb50 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): my global_id is 4239 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55b6d481fec0 con 0x55b6d479bb50 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985623315 0 0) 0x55b6d479c1a0 con 0x55b6d479b6f0 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:45.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): my global_id is 4225 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55b6d481fbe0 con 0x55b6d479b6f0 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 758884882 0 0) 0x7f1a98001e20 con 0x55b6d47a1520 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55b6d479c1a0 con 0x55b6d47a1520 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1aa8001c80 con 0x55b6d47a1520 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): dump: 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:45.287 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1589332601 0 0) 0x55b6d481fec0 con 0x55b6d479bb50 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a98001e20 con 0x55b6d479bb50 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1aa00018e0 con 0x55b6d479bb50 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): dump: 2026-02-13T08:05:45.288 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2425000983 0 0) 0x55b6d481fbe0 con 0x55b6d479b6f0 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55b6d481fec0 con 0x55b6d479b6f0 2026-02-13T08:05:45.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1aac001870 con 0x55b6d479b6f0 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient(hunting): dump: 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:45.290 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 230781255 0 0) 0x55b6d479c1a0 con 0x55b6d47a1520 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 >> v1:10.20.193.119:6789/0 conn(0x55b6d479b6f0 legacy=0x55b6d483fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 >> v1:10.20.193.104:6789/0 conn(0x55b6d479bb50 legacy=0x55b6d4840da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 monclient: found mon.c 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6d479ae40 con 0x55b6d47a1520 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient: _finish_auth 0 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:45.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 5 monclient: authenticate success, global_id 4226 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: _renew_subs 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x55b6d4853ff0 con 0x55b6d47a1520 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 client.4226.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: _renew_subs 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x55b6d481f950 con 0x55b6d47a1520 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 librados: init done 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 librados: wait_for_osdmap waiting 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1aa8003460 con 0x55b6d47a1520 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1aa80037b0 con 0x55b6d47a1520 2026-02-13T08:05:45.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 monclient: dump: 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:45.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab575f640 4 set_mon_vals no callback set 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f1aa800f620 con 0x55b6d47a1520 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(15..15 src has 1..15) ==== 3492+0+0 (unknown 3982726134 0 0) 0x7f1aa8048b40 con 0x55b6d47a1520 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 client.4226.objecter ms_dispatch2 0x55b6d469aba0 osd_map(15..15 src has 1..15) 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 3 client.4226.objecter handle_osd_map got epochs [15,15] > 0 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 3 client.4226.objecter handle_osd_map decoding full epoch 15 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 20 client.4226.objecter dump_active .. 0 homeless 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 librados: wait_for_osdmap done waiting 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55b6d481d3e0 con 0x55b6d47a1520 2026-02-13T08:05:45.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1ab6f62640 10 monclient: get_auth_request con 0x7f1a9803a330 auth_method 0 2026-02-13T08:05:45.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:45.260+0000 7f1a9effd640 10 client.4226.objecter ms_handle_connect 0x7f1a9803a330 2026-02-13T08:05:46.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.228+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (unknown 2855932958 0 0) 0x7f1aa8015620 con 0x55b6d47a1520 2026-02-13T08:05:46.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.228+0000 7f1a9effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-13T08:05:46.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.228+0000 7f1a9effd640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-13T08:05:46.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.228+0000 7f1ab848e200 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:46.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.228+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x55b6d46742a0 con 0x55b6d47a1520 2026-02-13T08:05:46.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.228+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (unknown 3847591702 0 0) 0x7f1aa8014cf0 con 0x55b6d47a1520 2026-02-13T08:05:46.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.228+0000 7f1a9effd640 10 monclient: handle_get_version_reply finishing 1 version 16 2026-02-13T08:05:46.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab575f640 10 client.4226.objecter _get_latest_version latest 16, waiting 2026-02-13T08:05:46.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab575f640 10 client.4226.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:46.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab575f640 10 monclient: _renew_subs 2026-02-13T08:05:46.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab575f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab575f640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=16}) -- 0x7f1a90002af0 con 0x55b6d47a1520 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 11 ==== osd_map(16..16 src has 1..16) ==== 661+0+0 (unknown 2218334520 0 0) 0x7f1aa8047aa0 con 0x55b6d47a1520 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1a9effd640 10 client.4226.objecter ms_dispatch2 0x55b6d469aba0 osd_map(16..16 src has 1..16) 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1a9effd640 3 client.4226.objecter handle_osd_map got epochs [16,16] > 15 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1a9effd640 3 client.4226.objecter handle_osd_map decoding incremental epoch 16 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1a9effd640 20 client.4226.objecter dump_active .. 0 homeless 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 10 librados: create oid=rbd_trash nspace= 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 10 client.4226.objecter _op_submit op 0x55b6d4843be0 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 20 client.4226.objecter _calc_target epoch 16 base rbd_trash @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 20 client.4226.objecter _calc_target target rbd_trash @2 -> pgid 2.5a749323 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 10 client.4226.objecter _calc_target raw pgid 2.5a749323 -> actual 2.3 acting [5,2] primary 5 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 20 client.4226.objecter _get_session s=0x55b6d45f4ab0 osd=5 3 2026-02-13T08:05:46.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 10 client.4226.objecter _op_submit oid rbd_trash '@2' '@2' [create] tid 1 osd.5 2026-02-13T08:05:46.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 20 client.4226.objecter get_session s=0x55b6d45f4ab0 osd=5 3 2026-02-13T08:05:46.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 15 client.4226.objecter _session_op_assign 5 1 2026-02-13T08:05:46.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 15 client.4226.objecter _send_op 1 to 2.3 on osd.5 2026-02-13T08:05:46.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.119:6804/527707922 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x55b6d4845cc0 con 0x55b6d4840790 2026-02-13T08:05:46.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 20 client.4226.objecter put_session s=0x55b6d45f4ab0 osd=5 4 2026-02-13T08:05:46.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 5 client.4226.objecter 1 in flight 2026-02-13T08:05:46.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab6761640 10 monclient: get_auth_request con 0x55b6d4840790 auth_method 0 2026-02-13T08:05:46.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1a9effd640 10 client.4226.objecter ms_handle_connect 0x55b6d4840790 2026-02-13T08:05:46.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab6761640 1 -- 10.20.193.104:0/1389455400 <== osd.5 v1:10.20.193.119:6804/527707922 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 2685446591 0 0) 0x7f1aa0004190 con 0x55b6d4840790 2026-02-13T08:05:46.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab6761640 10 client.4226.objecter ms_dispatch2 0x55b6d469aba0 osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) 2026-02-13T08:05:46.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab6761640 10 client.4226.objecter in handle_osd_op_reply 2026-02-13T08:05:46.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab6761640 7 client.4226.objecter handle_osd_op_reply 1 ondisk uv 1 in 2.3 attempt 0 2026-02-13T08:05:46.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab6761640 10 client.4226.objecter op 0 rval 0 len 0 2026-02-13T08:05:46.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab6761640 15 client.4226.objecter handle_osd_op_reply completed tid 1 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab6761640 15 client.4226.objecter _finish_op 1 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab6761640 20 client.4226.objecter put_session s=0x55b6d45f4ab0 osd=5 4 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab6761640 15 client.4226.objecter _session_op_remove 5 1 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab6761640 5 client.4226.objecter 0 in flight 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 10 librados: Objecter returned from create r=0 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 10 client.4226.objecter _op_submit op 0x55b6d4923e40 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 20 client.4226.objecter _calc_target epoch 16 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 20 client.4226.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 10 client.4226.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [5,1] primary 5 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 20 client.4226.objecter _get_session s=0x55b6d45f4ab0 osd=5 3 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 10 client.4226.objecter _op_submit oid rbd_info '@2' '@2' [call rbd.metadata_list in=33b] tid 2 osd.5 2026-02-13T08:05:46.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 20 client.4226.objecter get_session s=0x55b6d45f4ab0 osd=5 3 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 15 client.4226.objecter _session_op_assign 5 2 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 15 client.4226.objecter _send_op 2 to 2.2 on osd.5 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.119:6804/527707922 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x55b6d4924390 con 0x55b6d4840790 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 20 client.4226.objecter put_session s=0x55b6d45f4ab0 osd=5 4 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.232+0000 7f1ab848e200 5 client.4226.objecter 1 in flight 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 1 -- 10.20.193.104:0/1389455400 <== osd.5 v1:10.20.193.119:6804/527707922 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 2026326479 0 0) 0x7f1aa0004190 con 0x55b6d4840790 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 10 client.4226.objecter ms_dispatch2 0x55b6d469aba0 osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 10 client.4226.objecter in handle_osd_op_reply 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 7 client.4226.objecter handle_osd_op_reply 2 ondisk uv 0 in 2.2 attempt 0 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 10 client.4226.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 10 client.4226.objecter op 0 rval 0 len 0 2026-02-13T08:05:46.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 15 client.4226.objecter handle_osd_op_reply completed tid 2 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 15 client.4226.objecter _finish_op 2 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 20 client.4226.objecter put_session s=0x55b6d45f4ab0 osd=5 4 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 15 client.4226.objecter _session_op_remove 5 2 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 5 client.4226.objecter 0 in flight 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 10 client.4226.objecter _op_submit op 0x55b6d4922fd0 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 20 client.4226.objecter _calc_target epoch 16 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 20 client.4226.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 10 client.4226.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [5,1] primary 5 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 20 client.4226.objecter _get_session s=0x55b6d45f4ab0 osd=5 3 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 10 client.4226.objecter _op_submit oid rbd_info '@2' '@2' [read 0~0] tid 3 osd.5 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 20 client.4226.objecter get_session s=0x55b6d45f4ab0 osd=5 3 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 15 client.4226.objecter _session_op_assign 5 3 2026-02-13T08:05:46.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 15 client.4226.objecter _send_op 3 to 2.2 on osd.5 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.119:6804/527707922 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x55b6d4923480 con 0x55b6d4840790 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 20 client.4226.objecter put_session s=0x55b6d45f4ab0 osd=5 4 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab848e200 5 client.4226.objecter 1 in flight 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 1 -- 10.20.193.104:0/1389455400 <== osd.5 v1:10.20.193.119:6804/527707922 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 2039985091 0 0) 0x7f1aa0004190 con 0x55b6d4840790 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 10 client.4226.objecter ms_dispatch2 0x55b6d469aba0 osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 10 client.4226.objecter in handle_osd_op_reply 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 7 client.4226.objecter handle_osd_op_reply 3 ondisk uv 0 in 2.2 attempt 0 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 10 client.4226.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 10 client.4226.objecter op 0 rval 0 len 0 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 15 client.4226.objecter handle_osd_op_reply completed tid 3 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 15 client.4226.objecter _finish_op 3 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 20 client.4226.objecter put_session s=0x55b6d45f4ab0 osd=5 4 2026-02-13T08:05:46.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 15 client.4226.objecter _session_op_remove 5 3 2026-02-13T08:05:46.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab6761640 5 client.4226.objecter 0 in flight 2026-02-13T08:05:46.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab4f5e640 10 client.4226.objecter allocate_selfmanaged_snap; pool: 2 2026-02-13T08:05:46.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab4f5e640 10 client.4226.objecter pool_op_submit 4 2026-02-13T08:05:46.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab4f5e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:46.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:46.236+0000 7f1ab4f5e640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f1a94003120 con 0x55b6d47a1520 2026-02-13T08:05:47.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 12 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (unknown 1074177468 0 0) 0x7f1aa801a540 con 0x55b6d47a1520 2026-02-13T08:05:47.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 10 client.4226.objecter ms_dispatch2 0x55b6d469aba0 pool_op_reply(tid 4 (0) Success v17) 2026-02-13T08:05:47.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 10 client.4226.objecter handle_pool_op_reply pool_op_reply(tid 4 (0) Success v17) 2026-02-13T08:05:47.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 10 client.4226.objecter have request 4 at 0x7f1a940030b0 Op: create unmanaged snap 2026-02-13T08:05:47.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 20 client.4226.objecter waiting for client to reach epoch 17 before calling back 2026-02-13T08:05:47.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 10 client.4226.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:47.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 10 monclient: _renew_subs 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=17}) -- 0x55b6d479c1a0 con 0x55b6d47a1520 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 10 client.4226.objecter done 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 13 ==== osd_map(17..17 src has 1..17) ==== 629+0+0 (unknown 897470283 0 0) 0x7f1aa8015180 con 0x55b6d47a1520 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 10 client.4226.objecter ms_dispatch2 0x55b6d469aba0 osd_map(17..17 src has 1..17) 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 3 client.4226.objecter handle_osd_map got epochs [17,17] > 16 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 3 client.4226.objecter handle_osd_map decoding incremental epoch 17 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1a9effd640 20 client.4226.objecter dump_active .. 0 homeless 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 20 librados: queue_aio_write 0x55b6d491f3d0 completion 0x55b6d46176d0 write_seq 1 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 10 client.4226.objecter _op_submit op 0x7f1a900063c0 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 20 client.4226.objecter _calc_target epoch 17 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 20 client.4226.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-13T08:05:47.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 10 client.4226.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [5,1] primary 5 2026-02-13T08:05:47.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 20 client.4226.objecter _get_session s=0x55b6d45f4ab0 osd=5 3 2026-02-13T08:05:47.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 10 client.4226.objecter _op_submit oid rbd_info '@2' '@2' [create,write 0~8 in=8b] tid 5 osd.5 2026-02-13T08:05:47.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 20 client.4226.objecter get_session s=0x55b6d45f4ab0 osd=5 3 2026-02-13T08:05:47.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 15 client.4226.objecter _session_op_assign 5 5 2026-02-13T08:05:47.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 15 client.4226.objecter _send_op 5 to 2.2 on osd.5 2026-02-13T08:05:47.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.119:6804/527707922 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f1a90006a00 con 0x55b6d4840790 2026-02-13T08:05:47.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 20 client.4226.objecter put_session s=0x55b6d45f4ab0 osd=5 4 2026-02-13T08:05:47.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.232+0000 7f1ab575f640 5 client.4226.objecter 1 in flight 2026-02-13T08:05:47.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 1 -- 10.20.193.104:0/1389455400 <== osd.5 v1:10.20.193.119:6804/527707922 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 3115756469 0 0) 0x7f1aa0004190 con 0x55b6d4840790 2026-02-13T08:05:47.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 10 client.4226.objecter ms_dispatch2 0x55b6d469aba0 osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) 2026-02-13T08:05:47.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 10 client.4226.objecter in handle_osd_op_reply 2026-02-13T08:05:47.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 7 client.4226.objecter handle_osd_op_reply 5 ondisk uv 1 in 2.2 attempt 0 2026-02-13T08:05:47.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 10 client.4226.objecter op 0 rval 0 len 0 2026-02-13T08:05:47.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 10 client.4226.objecter op 1 rval 0 len 0 2026-02-13T08:05:47.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 15 client.4226.objecter handle_osd_op_reply completed tid 5 2026-02-13T08:05:47.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 15 client.4226.objecter _finish_op 5 2026-02-13T08:05:47.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 20 client.4226.objecter put_session s=0x55b6d45f4ab0 osd=5 4 2026-02-13T08:05:47.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 15 client.4226.objecter _session_op_remove 5 5 2026-02-13T08:05:47.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 5 client.4226.objecter 0 in flight 2026-02-13T08:05:47.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab6761640 20 librados: complete_aio_write 0x55b6d46176d0 2026-02-13T08:05:47.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab4f5e640 10 client.4226.objecter delete_selfmanaged_snap; pool: 2; snap: 2 2026-02-13T08:05:47.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab4f5e640 10 client.4226.objecter pool_op_submit 6 2026-02-13T08:05:47.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab4f5e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:47.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:47.236+0000 7f1ab4f5e640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7f1a940033c0 con 0x55b6d47a1520 2026-02-13T08:05:48.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 14 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (unknown 1159700285 0 0) 0x7f1aa801f6d0 con 0x55b6d47a1520 2026-02-13T08:05:48.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 10 client.4226.objecter ms_dispatch2 0x55b6d469aba0 pool_op_reply(tid 6 (0) Success v18) 2026-02-13T08:05:48.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 10 client.4226.objecter handle_pool_op_reply pool_op_reply(tid 6 (0) Success v18) 2026-02-13T08:05:48.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 10 client.4226.objecter have request 6 at 0x7f1a940030b0 Op: delete unmanaged snap 2026-02-13T08:05:48.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 20 client.4226.objecter waiting for client to reach epoch 18 before calling back 2026-02-13T08:05:48.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 10 client.4226.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:48.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 10 monclient: _renew_subs 2026-02-13T08:05:48.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=18}) -- 0x55b6d481fbe0 con 0x55b6d47a1520 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 10 client.4226.objecter done 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 1 -- 10.20.193.104:0/1389455400 <== mon.2 v1:10.20.193.104:6790/0 15 ==== osd_map(18..18 src has 1..18) ==== 657+0+0 (unknown 1707940064 0 0) 0x7f1aa8015380 con 0x55b6d47a1520 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 10 client.4226.objecter ms_dispatch2 0x55b6d469aba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 3 client.4226.objecter handle_osd_map got epochs [18,18] > 17 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 3 client.4226.objecter handle_osd_map decoding incremental epoch 18 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1a9effd640 20 client.4226.objecter dump_active .. 0 homeless 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 20 librados: queue_aio_write 0x55b6d491f3d0 completion 0x7f1a94001db0 write_seq 2 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 10 client.4226.objecter _op_submit op 0x7f1a900063c0 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 20 client.4226.objecter _calc_target epoch 18 base rbd_info @2 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 20 client.4226.objecter _calc_target target rbd_info @2 -> pgid 2.ac0e573a 2026-02-13T08:05:48.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 10 client.4226.objecter _calc_target raw pgid 2.ac0e573a -> actual 2.2 acting [5,1] primary 5 2026-02-13T08:05:48.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 20 client.4226.objecter _get_session s=0x55b6d45f4ab0 osd=5 3 2026-02-13T08:05:48.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 10 client.4226.objecter _op_submit oid rbd_info '@2' '@2' [write 0~19 in=19b] tid 7 osd.5 2026-02-13T08:05:48.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 20 client.4226.objecter get_session s=0x55b6d45f4ab0 osd=5 3 2026-02-13T08:05:48.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 15 client.4226.objecter _session_op_assign 5 7 2026-02-13T08:05:48.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 15 client.4226.objecter _send_op 7 to 2.2 on osd.5 2026-02-13T08:05:48.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 1 -- 10.20.193.104:0/1389455400 --> v1:10.20.193.119:6804/527707922 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f1a90006e00 con 0x55b6d4840790 2026-02-13T08:05:48.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 20 client.4226.objecter put_session s=0x55b6d45f4ab0 osd=5 4 2026-02-13T08:05:48.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab575f640 5 client.4226.objecter 1 in flight 2026-02-13T08:05:48.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab6761640 1 -- 10.20.193.104:0/1389455400 <== osd.5 v1:10.20.193.119:6804/527707922 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 4030416863 0 0) 0x7f1aa0004190 con 0x55b6d4840790 2026-02-13T08:05:48.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab6761640 10 client.4226.objecter ms_dispatch2 0x55b6d469aba0 osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) 2026-02-13T08:05:48.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab6761640 10 client.4226.objecter in handle_osd_op_reply 2026-02-13T08:05:48.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab6761640 7 client.4226.objecter handle_osd_op_reply 7 ondisk uv 2 in 2.2 attempt 0 2026-02-13T08:05:48.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab6761640 10 client.4226.objecter op 0 rval 0 len 0 2026-02-13T08:05:48.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab6761640 15 client.4226.objecter handle_osd_op_reply completed tid 7 2026-02-13T08:05:48.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab6761640 15 client.4226.objecter _finish_op 7 2026-02-13T08:05:48.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab6761640 20 client.4226.objecter put_session s=0x55b6d45f4ab0 osd=5 4 2026-02-13T08:05:48.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab6761640 15 client.4226.objecter _session_op_remove 5 7 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab6761640 5 client.4226.objecter 0 in flight 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab6761640 20 librados: complete_aio_write 0x7f1a94001db0 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 10 librados: watch_flush enter 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 10 librados: watch_flush exit 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 10 client.4226.objecter close_session for osd.5 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 >> v1:10.20.193.119:6804/527707922 conn(0x55b6d4840790 legacy=0x55b6d48445a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 20 client.4226.objecter put_session s=0x55b6d45f4ab0 osd=5 1 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 20 client.4226.objecter shutdown clearing up homeless session... 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 10 client.4226.objecter successfully canceled tick 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 >> v1:10.20.193.119:6812/276487904 conn(0x7f1a9803a330 legacy=0x7f1a9805a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 10 monclient: shutdown 2026-02-13T08:05:48.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:48.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 >> v1:10.20.193.104:6790/0 conn(0x55b6d47a1520 legacy=0x55b6d48424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab81eb640 1 -- 10.20.193.104:0/1389455400 reap_dead start 2026-02-13T08:05:48.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 shutdown_connections 2026-02-13T08:05:48.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 >> 10.20.193.104:0/1389455400 conn(0x55b6d4783a20 msgr2=0x55b6d4835380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:48.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 shutdown_connections 2026-02-13T08:05:48.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 1 -- 10.20.193.104:0/1389455400 wait complete. 2026-02-13T08:05:48.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.236+0000 7f1ab848e200 1 librados: shutdown 2026-02-13T08:05:48.252 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-13T08:05:48.253 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-13T08:05:48.254 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-13T08:05:48.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.340+0000 7eff310a2640 10 monclient: get_monmap_and_config 2026-02-13T08:05:48.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.340+0000 7eff310a2640 10 monclient: build_initial_monmap 2026-02-13T08:05:48.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.340+0000 7eff310a2640 10 monclient: monmap: 2026-02-13T08:05:48.350 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:48.350 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.350 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:48.347259+0000 2026-02-13T08:05:48.350 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:48.347259+0000 2026-02-13T08:05:48.350 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:48.350 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.350 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:48.351 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:48.351 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:48.351 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.340+0000 7eff310a2640 1 Processor -- start 2026-02-13T08:05:48.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.340+0000 7eff310a2640 1 -- start start 2026-02-13T08:05:48.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.340+0000 7eff310a2640 10 monclient: init 2026-02-13T08:05:48.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:48.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:48.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient(hunting): picked mon.noname-a con 0x7eff2c05c220 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:48.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient(hunting): picked mon.noname-c con 0x7eff2c05cd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:48.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient(hunting): picked mon.noname-b con 0x7eff2c181d90 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:48.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c08fa20 con 0x7eff2c05c220 2026-02-13T08:05:48.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c08f7a0 con 0x7eff2c05cd00 2026-02-13T08:05:48.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c08c960 con 0x7eff2c181d90 2026-02-13T08:05:48.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:48.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient(hunting): authenticate will time out at 453.936152s 2026-02-13T08:05:48.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff2ad76640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7eff2c05c220 0x7eff2c05c5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:41922/0 (socket says 10.20.193.104:41922) 2026-02-13T08:05:48.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff2ad76640 1 -- 10.20.193.104:0/2659993196 learned_addr learned my addr 10.20.193.104:0/2659993196 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:48.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388320398 0 0) 0x7eff2c08c960 con 0x7eff2c181d90 2026-02-13T08:05:48.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): my global_id is 4229 2026-02-13T08:05:48.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff18003620 con 0x7eff2c181d90 2026-02-13T08:05:48.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493409544 0 0) 0x7eff2c08fa20 con 0x7eff2c05c220 2026-02-13T08:05:48.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): my global_id is 4242 2026-02-13T08:05:48.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff2c08c960 con 0x7eff2c05c220 2026-02-13T08:05:48.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372370854 0 0) 0x7eff2c08f7a0 con 0x7eff2c05cd00 2026-02-13T08:05:48.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient(hunting): my global_id is 4228 2026-02-13T08:05:48.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff2c08fa20 con 0x7eff2c05cd00 2026-02-13T08:05:48.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4011466147 0 0) 0x7eff18003620 con 0x7eff2c181d90 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 >> v1:10.20.193.119:6789/0 conn(0x7eff2c05cd00 legacy=0x7eff2c180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 >> v1:10.20.193.104:6789/0 conn(0x7eff2c05c220 legacy=0x7eff2c05c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient: _finish_hunting 0 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 monclient: found mon.noname-b 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c08a7c0 con 0x7eff2c181d90 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient: _finish_auth 0 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient: _check_auth_tickets 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7eff1c003180 con 0x7eff2c181d90 2026-02-13T08:05:48.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient: dump: 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.363 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 5 monclient: authenticate success, global_id 4229 2026-02-13T08:05:48.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:48.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff1c003350 con 0x7eff2c181d90 2026-02-13T08:05:48.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:48.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 1 -- 10.20.193.104:0/2659993196 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7eff1c003790 con 0x7eff2c181d90 2026-02-13T08:05:48.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:48.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29d74640 10 monclient: dump: 2026-02-13T08:05:48.364 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.364 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.364 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 4 set_mon_vals no callback set 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: shutdown 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:48.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- 10.20.193.104:0/2659993196 >> v1:10.20.193.104:6790/0 conn(0x7eff2c181d90 legacy=0x7eff2c1a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- 10.20.193.104:0/2659993196 shutdown_connections 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- 10.20.193.104:0/2659993196 >> 10.20.193.104:0/2659993196 conn(0x7eff2c090240 msgr2=0x7eff2c08db40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- 10.20.193.104:0/2659993196 shutdown_connections 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- 10.20.193.104:0/2659993196 wait complete. 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: build_initial_monmap 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: monmap: 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:48.366 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.367 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:48.367 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:48.367 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:48.367 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 librados: starting msgr at 2026-02-13T08:05:48.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 librados: starting objecter 2026-02-13T08:05:48.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 Processor -- start 2026-02-13T08:05:48.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- start start 2026-02-13T08:05:48.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 librados: setting wanted keys 2026-02-13T08:05:48.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 librados: calling monclient init 2026-02-13T08:05:48.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: init 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient(hunting): picked mon.noname-b con 0x7eff2c05c220 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient(hunting): picked mon.noname-c con 0x7eff2c05cd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient(hunting): picked mon.noname-a con 0x7eff2c181d90 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c129940 con 0x7eff2c181d90 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c129f10 con 0x7eff2c05c220 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c1277b0 con 0x7eff2c05cd00 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient(hunting): authenticate will time out at 453.938535s 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff2b577640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7eff2c181d90 0x7eff2c181680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:41932/0 (socket says 10.20.193.104:41932) 2026-02-13T08:05:48.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff2b577640 1 -- 10.20.193.104:0/1263831977 learned_addr learned my addr 10.20.193.104:0/1263831977 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 client.?.objecter ms_handle_connect 0x7eff2c181d90 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 client.?.objecter ms_handle_connect 0x7eff2c05cd00 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3773545012 0 0) 0x7eff2c129940 con 0x7eff2c181d90 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): my global_id is 4245 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efef8003620 con 0x7eff2c181d90 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512443310 0 0) 0x7eff2c1277b0 con 0x7eff2c05cd00 2026-02-13T08:05:48.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): my global_id is 4232 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff2c129940 con 0x7eff2c05cd00 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 client.?.objecter ms_handle_connect 0x7eff2c05c220 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1406575783 0 0) 0x7eff2c129940 con 0x7eff2c05cd00 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff2c1277b0 con 0x7eff2c05cd00 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7eff14003070 con 0x7eff2c05cd00 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:48.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:48.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325429132 0 0) 0x7eff2c08c960 con 0x7eff2c05c220 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): my global_id is 4231 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff2c129940 con 0x7eff2c05c220 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 871312810 0 0) 0x7efef8003620 con 0x7eff2c181d90 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff2c08c960 con 0x7eff2c181d90 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7eff1c0036a0 con 0x7eff2c181d90 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:48.372 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.373 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.373 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.373 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.373 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.373 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.373 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.373 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.373 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.373 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1043659085 0 0) 0x7eff2c1277b0 con 0x7eff2c05cd00 2026-02-13T08:05:48.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 >> v1:10.20.193.119:6789/0 conn(0x7eff2c05c220 legacy=0x7eff2c126990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 >> v1:10.20.193.104:6789/0 conn(0x7eff2c181d90 legacy=0x7eff2c181680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 monclient: found mon.c 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c128450 con 0x7eff2c05cd00 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 5 monclient: authenticate success, global_id 4232 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: _renew_subs 2026-02-13T08:05:48.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- 10.20.193.104:0/1263831977 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7eff2c12a7b0 con 0x7eff2c05cd00 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 client.4232.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: _renew_subs 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- 10.20.193.104:0/1263831977 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7eff2c140150 con 0x7eff2c05cd00 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 librados: init done 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff140034c0 con 0x7eff2c05cd00 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7eff140039c0 con 0x7eff2c05cd00 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:48.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 monclient: dump: 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff29573640 4 set_mon_vals no callback set 2026-02-13T08:05:48.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff310a2640 1 -- 10.20.193.104:0/1263831977 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff2c061860 con 0x7eff2c05cd00 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7eff14003be0 con 0x7eff2c05cd00 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7eff14049040 con 0x7eff2c05cd00 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 10 client.4232.objecter ms_dispatch2 0x7eff2c000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 3 client.4232.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.344+0000 7eff0b7fe640 3 client.4232.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.348+0000 7eff0b7fe640 20 client.4232.objecter dump_active .. 0 homeless 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.348+0000 7eff2ad76640 10 monclient: get_auth_request con 0x7efef803b9e0 auth_method 0 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.348+0000 7eff0b7fe640 10 client.4232.objecter ms_handle_connect 0x7efef803b9e0 2026-02-13T08:05:48.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.348+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7eff14015b00 con 0x7eff2c05cd00 2026-02-13T08:05:48.378 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.348+0000 7eff0b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.378 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.348+0000 7eff0b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:48.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-13T08:05:48.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-13T08:05:48.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 1 -- 10.20.193.104:0/1263831977 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7eff2c129210 con 0x7eff2c05cd00 2026-02-13T08:05:48.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff0b7fe640 1 -- 10.20.193.104:0/1263831977 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (unknown 4269106227 0 102270264) 0x7eff14015400 con 0x7eff2c05cd00 2026-02-13T08:05:48.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff0b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-13T08:05:48.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff0b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:48.442 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:48.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 10 librados: watch_flush enter 2026-02-13T08:05:48.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 10 librados: watch_flush exit 2026-02-13T08:05:48.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 20 client.4232.objecter shutdown clearing up homeless session... 2026-02-13T08:05:48.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 10 client.4232.objecter successfully canceled tick 2026-02-13T08:05:48.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 1 -- 10.20.193.104:0/1263831977 >> v1:10.20.193.119:6812/276487904 conn(0x7efef803b9e0 legacy=0x7efef805be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 10 monclient: shutdown 2026-02-13T08:05:48.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:48.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 1 -- 10.20.193.104:0/1263831977 >> v1:10.20.193.104:6790/0 conn(0x7eff2c05cd00 legacy=0x7eff2c1270a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 1 -- 10.20.193.104:0/1263831977 shutdown_connections 2026-02-13T08:05:48.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.432+0000 7eff310a2640 1 -- 10.20.193.104:0/1263831977 >> 10.20.193.104:0/1263831977 conn(0x7eff2c090240 msgr2=0x7eff2c1a2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:48.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.436+0000 7eff310a2640 1 -- 10.20.193.104:0/1263831977 shutdown_connections 2026-02-13T08:05:48.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.436+0000 7eff310a2640 1 -- 10.20.193.104:0/1263831977 wait complete. 2026-02-13T08:05:48.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.436+0000 7eff310a2640 1 librados: shutdown 2026-02-13T08:05:48.452 INFO:teuthology.orchestra.run.trial104.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-13T08:05:48.452 INFO:tasks.ceph_manager:config epoch is 1 2026-02-13T08:05:48.452 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T08:05:48.452 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-13T08:05:48.453 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-13T08:05:48.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.504+0000 7f1ce15b3640 10 monclient: get_monmap_and_config 2026-02-13T08:05:48.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.504+0000 7f1ce15b3640 10 monclient: build_initial_monmap 2026-02-13T08:05:48.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.504+0000 7f1ce15b3640 10 monclient: monmap: 2026-02-13T08:05:48.514 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:48.514 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.514 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:48.511696+0000 2026-02-13T08:05:48.515 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:48.511696+0000 2026-02-13T08:05:48.515 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:48.515 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.515 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:48.515 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:48.515 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:48.515 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 Processor -- start 2026-02-13T08:05:48.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- start start 2026-02-13T08:05:48.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: init 2026-02-13T08:05:48.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:48.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:48.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient(hunting): picked mon.noname-b con 0x7f1cdc13e430 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient(hunting): picked mon.noname-a con 0x7f1cdc1604e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient(hunting): picked mon.noname-c con 0x7f1cdc181fe0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cdc08ee70 con 0x7f1cdc1604e0 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cdc08e5d0 con 0x7f1cdc181fe0 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cdc08e8b0 con 0x7f1cdc13e430 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient(hunting): authenticate will time out at 454.100692s 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cda7fc640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f1cdc1604e0 0x7f1cdc1808c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:41934/0 (socket says 10.20.193.104:41934) 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cda7fc640 1 -- 10.20.193.104:0/3221772887 learned_addr learned my addr 10.20.193.104:0/3221772887 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cdaffd640 1 --1- 10.20.193.104:0/3221772887 >> v1:10.20.193.104:6790/0 conn(0x7f1cdc13e430 0x7f1cdc13e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40358/0 (socket says 10.20.193.104:40358) 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732779043 0 0) 0x7f1cdc08ee70 con 0x7f1cdc1604e0 2026-02-13T08:05:48.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): my global_id is 4248 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cc8003620 con 0x7f1cdc1604e0 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290355525 0 0) 0x7f1cdc08e8b0 con 0x7f1cdc13e430 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): my global_id is 4235 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cdc08ee70 con 0x7f1cdc13e430 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946949043 0 0) 0x7f1cdc08e5d0 con 0x7f1cdc181fe0 2026-02-13T08:05:48.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient(hunting): my global_id is 4234 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cdc08e8b0 con 0x7f1cdc181fe0 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3965296843 0 0) 0x7f1cdc08ee70 con 0x7f1cdc13e430 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 >> v1:10.20.193.119:6789/0 conn(0x7f1cdc181fe0 legacy=0x7f1cdc1a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 >> v1:10.20.193.104:6789/0 conn(0x7f1cdc1604e0 legacy=0x7f1cdc1808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 monclient: found mon.noname-b 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc13ef10 con 0x7f1cdc13e430 2026-02-13T08:05:48.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:48.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:48.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:48.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1cd0002d00 con 0x7f1cdc13e430 2026-02-13T08:05:48.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:48.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient: dump: 2026-02-13T08:05:48.527 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.527 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.527 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.527 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 5 monclient: authenticate success, global_id 4235 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1cd0002ea0 con 0x7f1cdc13e430 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 1 -- 10.20.193.104:0/3221772887 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1cd0003260 con 0x7f1cdc13e430 2026-02-13T08:05:48.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd9ffb640 10 monclient: dump: 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 4 set_mon_vals no callback set 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: shutdown 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- 10.20.193.104:0/3221772887 >> v1:10.20.193.104:6790/0 conn(0x7f1cdc13e430 legacy=0x7f1cdc13e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- 10.20.193.104:0/3221772887 shutdown_connections 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- 10.20.193.104:0/3221772887 >> 10.20.193.104:0/3221772887 conn(0x7f1cdc090a40 msgr2=0x7f1cdc085e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- 10.20.193.104:0/3221772887 shutdown_connections 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- 10.20.193.104:0/3221772887 wait complete. 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: build_initial_monmap 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: monmap: 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:48.530 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:48.531 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:48.531 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:48.531 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:48.531 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.531 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:48.531 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:48.531 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:48.531 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 librados: starting msgr at 2026-02-13T08:05:48.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 librados: starting objecter 2026-02-13T08:05:48.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 Processor -- start 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- start start 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 librados: setting wanted keys 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 librados: calling monclient init 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: init 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient(hunting): picked mon.noname-c con 0x7f1cdc13e430 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient(hunting): picked mon.noname-a con 0x7f1cdc1604e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient(hunting): picked mon.noname-b con 0x7f1cdc181fe0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cdc164930 con 0x7f1cdc1604e0 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cdc164c10 con 0x7f1cdc181fe0 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cdc180bb0 con 0x7f1cdc13e430 2026-02-13T08:05:48.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient(hunting): authenticate will time out at 454.103128s 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cda7fc640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f1cdc1604e0 0x7f1cdc1804a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:41950/0 (socket says 10.20.193.104:41950) 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cda7fc640 1 -- 10.20.193.104:0/2643922229 learned_addr learned my addr 10.20.193.104:0/2643922229 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 client.?.objecter ms_handle_connect 0x7f1cdc1604e0 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 client.?.objecter ms_handle_connect 0x7f1cdc13e430 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1588197290 0 0) 0x7f1cdc164930 con 0x7f1cdc1604e0 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): my global_id is 4251 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ca8003620 con 0x7f1cdc1604e0 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653965987 0 0) 0x7f1cdc180bb0 con 0x7f1cdc13e430 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): my global_id is 4238 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cdc164930 con 0x7f1cdc13e430 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 client.?.objecter ms_handle_connect 0x7f1cdc181fe0 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3783444966 0 0) 0x7f1cdc164930 con 0x7f1cdc13e430 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1cdc180bb0 con 0x7f1cdc13e430 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1cd0003050 con 0x7f1cdc13e430 2026-02-13T08:05:48.534 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.535 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1802633954 0 0) 0x7f1ca8003620 con 0x7f1cdc1604e0 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1cdc164930 con 0x7f1cdc1604e0 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1cc40031d0 con 0x7f1cdc1604e0 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.536 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3684688680 0 0) 0x7f1cdc180bb0 con 0x7f1cdc13e430 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 >> v1:10.20.193.119:6789/0 conn(0x7f1cdc181fe0 legacy=0x7f1cdc12bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 >> v1:10.20.193.104:6789/0 conn(0x7f1cdc1604e0 legacy=0x7f1cdc1804a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 monclient: found mon.c 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:48.537 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cdc163da0 con 0x7f1cdc13e430 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 5 monclient: authenticate success, global_id 4238 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: _renew_subs 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- 10.20.193.104:0/2643922229 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1cdc1628b0 con 0x7f1cdc13e430 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 client.4238.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: _renew_subs 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 -- 10.20.193.104:0/2643922229 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1cdc181b00 con 0x7f1cdc13e430 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1ce15b3640 1 librados: init done 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1cd0002e80 con 0x7f1cdc13e430 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1cd0004d30 con 0x7f1cdc13e430 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cbb7fe640 10 monclient: dump: 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.539 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.508+0000 7f1cd97fa640 4 set_mon_vals no callback set 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1ce15b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1ce15b3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1ce15b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1ce15b3640 1 -- 10.20.193.104:0/2643922229 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cdc181df0 con 0x7f1cdc13e430 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f1cd0010d40 con 0x7f1cdc13e430 2026-02-13T08:05:48.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f1cd004a150 con 0x7f1cdc13e430 2026-02-13T08:05:48.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1cbb7fe640 10 client.4238.objecter ms_dispatch2 0x7f1cdc000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:48.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1cbb7fe640 3 client.4238.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:48.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1cbb7fe640 3 client.4238.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:48.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1cbb7fe640 20 client.4238.objecter dump_active .. 0 homeless 2026-02-13T08:05:48.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1cda7fc640 10 monclient: get_auth_request con 0x7f1ca803b890 auth_method 0 2026-02-13T08:05:48.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1cbb7fe640 10 client.4238.objecter ms_handle_connect 0x7f1ca803b890 2026-02-13T08:05:48.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.512+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f1cd0016b90 con 0x7f1cdc13e430 2026-02-13T08:05:48.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.516+0000 7f1cbb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.516+0000 7f1cbb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:48.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.616+0000 7f1ce15b3640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-13T08:05:48.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.616+0000 7f1ce15b3640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-13T08:05:48.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.616+0000 7f1ce15b3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.616+0000 7f1ce15b3640 1 -- 10.20.193.104:0/2643922229 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f1cdc0380f0 con 0x7f1cdc13e430 2026-02-13T08:05:48.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.616+0000 7f1cbb7fe640 1 -- 10.20.193.104:0/2643922229 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+92704 (unknown 481731318 0 2303762451) 0x7f1cd0016490 con 0x7f1cdc13e430 2026-02-13T08:05:48.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.616+0000 7f1cbb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-13T08:05:48.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.616+0000 7f1cbb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:48.627 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:48.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 10 librados: watch_flush enter 2026-02-13T08:05:48.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 10 librados: watch_flush exit 2026-02-13T08:05:48.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 20 client.4238.objecter shutdown clearing up homeless session... 2026-02-13T08:05:48.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 10 client.4238.objecter successfully canceled tick 2026-02-13T08:05:48.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 1 -- 10.20.193.104:0/2643922229 >> v1:10.20.193.119:6812/276487904 conn(0x7f1ca803b890 legacy=0x7f1ca805bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 10 monclient: shutdown 2026-02-13T08:05:48.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:48.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 1 -- 10.20.193.104:0/2643922229 >> v1:10.20.193.104:6790/0 conn(0x7f1cdc13e430 legacy=0x7f1cdc17fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 1 -- 10.20.193.104:0/2643922229 shutdown_connections 2026-02-13T08:05:48.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 1 -- 10.20.193.104:0/2643922229 >> 10.20.193.104:0/2643922229 conn(0x7f1cdc090a40 msgr2=0x7f1cdc086aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:48.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 1 -- 10.20.193.104:0/2643922229 shutdown_connections 2026-02-13T08:05:48.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 1 -- 10.20.193.104:0/2643922229 wait complete. 2026-02-13T08:05:48.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.620+0000 7f1ce15b3640 1 librados: shutdown 2026-02-13T08:05:48.636 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6812","nonce":276487904}]},"active_addr":"10.20.193.119:6812/276487904","active_change":"2026-02-13T08:05:37.859506+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self certificates generated and signed by cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.5","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:ceph20-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"how frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.119:0","nonce":3293537409}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.119:0","nonce":1195488052}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.119:0","nonce":140542414}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.119:0","nonce":3991042909}]}]} 2026-02-13T08:05:48.639 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-13T08:05:48.639 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-13T08:05:48.640 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T08:05:48.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.688+0000 7f8bc0e12640 10 monclient: get_monmap_and_config 2026-02-13T08:05:48.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.688+0000 7f8bc0e12640 10 monclient: build_initial_monmap 2026-02-13T08:05:48.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.688+0000 7f8bc0e12640 10 monclient: monmap: 2026-02-13T08:05:48.698 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:48.698 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.698 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:48.695282+0000 2026-02-13T08:05:48.698 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:48.695282+0000 2026-02-13T08:05:48.698 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:48.698 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.698 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:48.699 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:48.699 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:48.699 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.688+0000 7f8bc0e12640 1 Processor -- start 2026-02-13T08:05:48.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.688+0000 7f8bc0e12640 1 -- start start 2026-02-13T08:05:48.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.688+0000 7f8bc0e12640 10 monclient: init 2026-02-13T08:05:48.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:48.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:48.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient(hunting): picked mon.noname-b con 0x7f8bbc08e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:48.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient(hunting): picked mon.noname-a con 0x7f8bbc08ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:48.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient(hunting): picked mon.noname-c con 0x7f8bbc17fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:48.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bbc089fa0 con 0x7f8bbc08ef90 2026-02-13T08:05:48.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bbc089760 con 0x7f8bbc17fe50 2026-02-13T08:05:48.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bbc08af90 con 0x7f8bbc08e4b0 2026-02-13T08:05:48.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:48.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient(hunting): authenticate will time out at 454.284346s 2026-02-13T08:05:48.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bba575640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f8bbc08e4b0 0x7f8bbc08e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40368/0 (socket says 10.20.193.104:40368) 2026-02-13T08:05:48.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9d74640 1 --1- 10.20.193.104:0/2706572046 >> v1:10.20.193.104:6789/0 conn(0x7f8bbc08ef90 0x7f8bbc17e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:41962/0 (socket says 10.20.193.104:41962) 2026-02-13T08:05:48.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bba575640 1 -- 10.20.193.104:0/2706572046 learned_addr learned my addr 10.20.193.104:0/2706572046 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:48.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 -- 10.20.193.104:0/2706572046 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570940734 0 0) 0x7f8bbc089fa0 con 0x7f8bbc08ef90 2026-02-13T08:05:48.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient(hunting): my global_id is 4254 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 -- 10.20.193.104:0/2706572046 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ba8003620 con 0x7f8bbc08ef90 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 -- 10.20.193.104:0/2706572046 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2681691255 0 0) 0x7f8bbc08af90 con 0x7f8bbc08e4b0 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient(hunting): my global_id is 4241 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 -- 10.20.193.104:0/2706572046 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bbc089fa0 con 0x7f8bbc08e4b0 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 -- 10.20.193.104:0/2706572046 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3891156636 0 0) 0x7f8ba8003620 con 0x7f8bbc08ef90 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 -- 10.20.193.104:0/2706572046 >> v1:10.20.193.104:6790/0 conn(0x7f8bbc08e4b0 legacy=0x7f8bbc08e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 -- 10.20.193.104:0/2706572046 >> v1:10.20.193.119:6789/0 conn(0x7f8bbc17fe50 legacy=0x7f8bbc1a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient: _finish_hunting 0 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 monclient: found mon.noname-a 2026-02-13T08:05:48.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 -- 10.20.193.104:0/2706572046 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bbc08b270 con 0x7f8bbc08ef90 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient: _finish_auth 0 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient: _check_auth_tickets 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 -- 10.20.193.104:0/2706572046 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f8ba4002e00 con 0x7f8bbc08ef90 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient: dump: 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.711 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 5 monclient: authenticate success, global_id 4254 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 -- 10.20.193.104:0/2706572046 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ba4003010 con 0x7f8bbc08ef90 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:48.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 1 -- 10.20.193.104:0/2706572046 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f8ba4003450 con 0x7f8bbc08ef90 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9573640 10 monclient: dump: 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.713 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 4 set_mon_vals no callback set 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: shutdown 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- 10.20.193.104:0/2706572046 >> v1:10.20.193.104:6789/0 conn(0x7f8bbc08ef90 legacy=0x7f8bbc17e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- 10.20.193.104:0/2706572046 shutdown_connections 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- 10.20.193.104:0/2706572046 >> 10.20.193.104:0/2706572046 conn(0x7f8bbc051e80 msgr2=0x7f8bbc08c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- 10.20.193.104:0/2706572046 shutdown_connections 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- 10.20.193.104:0/2706572046 wait complete. 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: build_initial_monmap 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: monmap: 2026-02-13T08:05:48.714 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:48.715 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:48.715 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:48.715 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:48.715 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:48.715 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.715 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:48.715 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:48.715 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:48.715 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 librados: starting msgr at 2026-02-13T08:05:48.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 librados: starting objecter 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 Processor -- start 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- start start 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 librados: setting wanted keys 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 librados: calling monclient init 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: init 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient(hunting): picked mon.noname-c con 0x7f8bbc08e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient(hunting): picked mon.noname-a con 0x7f8bbc08ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient(hunting): picked mon.noname-b con 0x7f8bbc17fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bbc086790 con 0x7f8bbc08ef90 2026-02-13T08:05:48.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bbc07e910 con 0x7f8bbc17fe50 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bbc07f9a0 con 0x7f8bbc08e4b0 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient(hunting): authenticate will time out at 454.286898s 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9d74640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f8bbc08ef90 0x7f8bbc083f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:41974/0 (socket says 10.20.193.104:41974) 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb9d74640 1 -- 10.20.193.104:0/1133485816 learned_addr learned my addr 10.20.193.104:0/1133485816 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 client.?.objecter ms_handle_connect 0x7f8bbc08ef90 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 client.?.objecter ms_handle_connect 0x7f8bbc08e4b0 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786816852 0 0) 0x7f8bbc086790 con 0x7f8bbc08ef90 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): my global_id is 4257 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b88003620 con 0x7f8bbc08ef90 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945306712 0 0) 0x7f8bbc07f9a0 con 0x7f8bbc08e4b0 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): my global_id is 4244 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bbc086790 con 0x7f8bbc08e4b0 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 client.?.objecter ms_handle_connect 0x7f8bbc17fe50 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2957404152 0 0) 0x7f8b88003620 con 0x7f8bbc08ef90 2026-02-13T08:05:48.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8bbc07f9a0 con 0x7f8bbc08ef90 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f8ba4003360 con 0x7f8bbc08ef90 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): dump: 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.719 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3568142414 0 0) 0x7f8bbc086790 con 0x7f8bbc08e4b0 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8b88003620 con 0x7f8bbc08e4b0 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f8bb00031d0 con 0x7f8bbc08e4b0 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): dump: 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.720 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806597587 0 0) 0x7f8bbc07e910 con 0x7f8bbc17fe50 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient(hunting): my global_id is 4243 2026-02-13T08:05:48.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bbc086790 con 0x7f8bbc17fe50 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 600694040 0 0) 0x7f8bbc07f9a0 con 0x7f8bbc08ef90 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 >> v1:10.20.193.104:6790/0 conn(0x7f8bbc08e4b0 legacy=0x7f8bbc12dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 >> v1:10.20.193.119:6789/0 conn(0x7f8bbc17fe50 legacy=0x7f8bbc1700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 monclient: found mon.a 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bbc07f100 con 0x7f8bbc08ef90 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient: _finish_auth 0 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:48.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 5 monclient: authenticate success, global_id 4257 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: _renew_subs 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- 10.20.193.104:0/1133485816 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8bbc07e1a0 con 0x7f8bbc08ef90 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 client.4257.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: _renew_subs 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ba4004c30 con 0x7f8bbc08ef90 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- 10.20.193.104:0/1133485816 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8bbc0847e0 con 0x7f8bbc08ef90 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 librados: init done 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f8ba4004f80 con 0x7f8bbc08ef90 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bb8d72640 4 set_mon_vals no callback set 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8ba2ffd640 10 monclient: dump: 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.724 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.692+0000 7f8bc0e12640 1 -- 10.20.193.104:0/1133485816 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bbc061860 con 0x7f8bbc08ef90 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.696+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f8ba4010f90 con 0x7f8bbc08ef90 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.696+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f8ba404a100 con 0x7f8bbc08ef90 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.696+0000 7f8ba2ffd640 10 client.4257.objecter ms_dispatch2 0x7f8bbc000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.696+0000 7f8ba2ffd640 3 client.4257.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.696+0000 7f8ba2ffd640 3 client.4257.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.696+0000 7f8ba2ffd640 20 client.4257.objecter dump_active .. 0 homeless 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.696+0000 7f8bba575640 10 monclient: get_auth_request con 0x7f8b8803ba70 auth_method 0 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.696+0000 7f8ba2ffd640 10 client.4257.objecter ms_handle_connect 0x7f8b8803ba70 2026-02-13T08:05:48.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.700+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f8ba4016ba0 con 0x7f8bbc08ef90 2026-02-13T08:05:48.726 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.700+0000 7f8ba2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.726 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.700+0000 7f8ba2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:48.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.776+0000 7f8bc0e12640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:48.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.776+0000 7f8bc0e12640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:48.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.776+0000 7f8bc0e12640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:48.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.776+0000 7f8bc0e12640 1 -- 10.20.193.104:0/1133485816 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bbc07f340 con 0x7f8bbc08ef90 2026-02-13T08:05:48.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8ba2ffd640 1 -- 10.20.193.104:0/1133485816 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+10887 (unknown 3338201251 0 4059467632) 0x7f8ba40164a0 con 0x7f8bbc08ef90 2026-02-13T08:05:48.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8ba2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:48.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8ba2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:48.787 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:48.787 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":18,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","created":"2026-02-13T08:05:35.908543+0000","modified":"2026-02-13T08:05:48.237266+0000","last_up_change":"2026-02-13T08:05:40.923658+0000","last_in_change":"2026-02-13T08:05:36.956118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T08:05:41.903600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T08:05:44.705774+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"460b851b-aaa4-48d1-a60f-7c4d57195f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6808","nonce":1354850314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6809","nonce":1354850314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6811","nonce":1354850314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6810","nonce":1354850314}]},"public_addr":"10.20.193.104:6808/1354850314","cluster_addr":"10.20.193.104:6809/1354850314","heartbeat_back_addr":"10.20.193.104:6811/1354850314","heartbeat_front_addr":"10.20.193.104:6810/1354850314","state":["exists","up"]},{"osd":1,"uuid":"b96ae2ae-1756-45e7-932c-2e09b469bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6804","nonce":3474406264}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6805","nonce":3474406264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6807","nonce":3474406264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6806","nonce":3474406264}]},"public_addr":"10.20.193.104:6804/3474406264","cluster_addr":"10.20.193.104:6805/3474406264","heartbeat_back_addr":"10.20.193.104:6807/3474406264","heartbeat_front_addr":"10.20.193.104:6806/3474406264","state":["exists","up"]},{"osd":2,"uuid":"1ae934c3-1aba-4596-abae-1b7697ebf029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6800","nonce":3938786817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6801","nonce":3938786817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6803","nonce":3938786817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6802","nonce":3938786817}]},"public_addr":"10.20.193.104:6800/3938786817","cluster_addr":"10.20.193.104:6801/3938786817","heartbeat_back_addr":"10.20.193.104:6803/3938786817","heartbeat_front_addr":"10.20.193.104:6802/3938786817","state":["exists","up"]},{"osd":3,"uuid":"029c49a7-88e6-439c-90f8-534c1b8e4056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6800","nonce":4283496532}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6801","nonce":4283496532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6803","nonce":4283496532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6802","nonce":4283496532}]},"public_addr":"10.20.193.119:6800/4283496532","cluster_addr":"10.20.193.119:6801/4283496532","heartbeat_back_addr":"10.20.193.119:6803/4283496532","heartbeat_front_addr":"10.20.193.119:6802/4283496532","state":["exists","up"]},{"osd":4,"uuid":"a8122973-739c-4b4b-a9f5-59eac5f15f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6808","nonce":1543069880}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6809","nonce":1543069880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6811","nonce":1543069880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6810","nonce":1543069880}]},"public_addr":"10.20.193.119:6808/1543069880","cluster_addr":"10.20.193.119:6809/1543069880","heartbeat_back_addr":"10.20.193.119:6811/1543069880","heartbeat_front_addr":"10.20.193.119:6810/1543069880","state":["exists","up"]},{"osd":5,"uuid":"8901cba8-49ff-4a2a-8f16-6b3db8eff80e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6804","nonce":527707922}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6805","nonce":527707922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6807","nonce":527707922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6806","nonce":527707922}]},"public_addr":"10.20.193.119:6804/527707922","cluster_addr":"10.20.193.119:6805/527707922","heartbeat_back_addr":"10.20.193.119:6807/527707922","heartbeat_front_addr":"10.20.193.119:6806/527707922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T08:05:48.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 10 librados: watch_flush enter 2026-02-13T08:05:48.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 10 librados: watch_flush exit 2026-02-13T08:05:48.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 20 client.4257.objecter shutdown clearing up homeless session... 2026-02-13T08:05:48.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 10 client.4257.objecter successfully canceled tick 2026-02-13T08:05:48.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 1 -- 10.20.193.104:0/1133485816 >> v1:10.20.193.119:6812/276487904 conn(0x7f8b8803ba70 legacy=0x7f8b8805bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 10 monclient: shutdown 2026-02-13T08:05:48.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:48.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 1 -- 10.20.193.104:0/1133485816 >> v1:10.20.193.104:6789/0 conn(0x7f8bbc08ef90 legacy=0x7f8bbc083f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 1 -- 10.20.193.104:0/1133485816 shutdown_connections 2026-02-13T08:05:48.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 1 -- 10.20.193.104:0/1133485816 >> 10.20.193.104:0/1133485816 conn(0x7f8bbc051e80 msgr2=0x7f8bbc084c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:48.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 1 -- 10.20.193.104:0/1133485816 shutdown_connections 2026-02-13T08:05:48.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 1 -- 10.20.193.104:0/1133485816 wait complete. 2026-02-13T08:05:48.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.780+0000 7f8bc0e12640 1 librados: shutdown 2026-02-13T08:05:48.797 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-13T08:05:48.797 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T08:05:48.857 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 10 monclient: get_monmap_and_config 2026-02-13T08:05:48.857 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 10 monclient: build_initial_monmap 2026-02-13T08:05:48.857 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 10 monclient: monmap: 2026-02-13T08:05:48.857 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:48.857 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.858 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:48.854837+0000 2026-02-13T08:05:48.858 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:48.854837+0000 2026-02-13T08:05:48.858 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:48.858 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.858 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:48.858 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:48.858 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:48.858 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 1 Processor -- start 2026-02-13T08:05:48.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 1 -- start start 2026-02-13T08:05:48.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 10 monclient: init 2026-02-13T08:05:48.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:48.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:48.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 10 monclient(hunting): picked mon.noname-c con 0x7f478813e430 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:48.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 10 monclient(hunting): picked mon.noname-a con 0x7f47881604e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:48.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 10 monclient(hunting): picked mon.noname-b con 0x7f4788181fe0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:48.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478808ee70 con 0x7f47881604e0 2026-02-13T08:05:48.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478808e5d0 con 0x7f478813e430 2026-02-13T08:05:48.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478808e8b0 con 0x7f4788181fe0 2026-02-13T08:05:48.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478f4ce640 10 monclient(hunting): authenticate will time out at 454.443565s 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478ca42640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f47881604e0 0x7f47881808c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:41982/0 (socket says 10.20.193.104:41982) 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f478ca42640 1 -- 10.20.193.104:0/3070409426 learned_addr learned my addr 10.20.193.104:0/3070409426 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 1 -- 10.20.193.104:0/3070409426 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2574118396 0 0) 0x7f478808e8b0 con 0x7f4788181fe0 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 10 monclient(hunting): my global_id is 4247 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 1 -- 10.20.193.104:0/3070409426 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4770003620 con 0x7f4788181fe0 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 1 -- 10.20.193.104:0/3070409426 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285429002 0 0) 0x7f478808ee70 con 0x7f47881604e0 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 10 monclient(hunting): my global_id is 4260 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.848+0000 7f4777fff640 1 -- 10.20.193.104:0/3070409426 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f478808e8b0 con 0x7f47881604e0 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 1 -- 10.20.193.104:0/3070409426 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 956515014 0 0) 0x7f4770003620 con 0x7f4788181fe0 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 1 -- 10.20.193.104:0/3070409426 >> v1:10.20.193.119:6789/0 conn(0x7f478813e430 legacy=0x7f478813e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 1 -- 10.20.193.104:0/3070409426 >> v1:10.20.193.104:6789/0 conn(0x7f47881604e0 legacy=0x7f47881808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 1 monclient: found mon.noname-b 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 1 -- 10.20.193.104:0/3070409426 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478813ef10 con 0x7f4788181fe0 2026-02-13T08:05:48.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 10 monclient: _finish_auth 0 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 1 -- 10.20.193.104:0/3070409426 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4784003180 con 0x7f4788181fe0 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 10 monclient: dump: 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.869 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.870 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.870 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.870 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.870 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 5 monclient: authenticate success, global_id 4247 2026-02-13T08:05:48.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:48.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 1 -- 10.20.193.104:0/3070409426 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4784003350 con 0x7f4788181fe0 2026-02-13T08:05:48.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:48.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 1 -- 10.20.193.104:0/3070409426 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4784003790 con 0x7f4788181fe0 2026-02-13T08:05:48.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4777fff640 10 monclient: dump: 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 4 set_mon_vals no callback set 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: shutdown 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- 10.20.193.104:0/3070409426 >> v1:10.20.193.104:6790/0 conn(0x7f4788181fe0 legacy=0x7f47881a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- 10.20.193.104:0/3070409426 shutdown_connections 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- 10.20.193.104:0/3070409426 >> 10.20.193.104:0/3070409426 conn(0x7f4788090a40 msgr2=0x7f4788085e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- 10.20.193.104:0/3070409426 shutdown_connections 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- 10.20.193.104:0/3070409426 wait complete. 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: build_initial_monmap 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: monmap: 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:48.872 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 librados: starting msgr at 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 librados: starting objecter 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 Processor -- start 2026-02-13T08:05:48.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- start start 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 librados: setting wanted keys 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 librados: calling monclient init 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: init 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient(hunting): picked mon.noname-b con 0x7f478813e430 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient(hunting): picked mon.noname-c con 0x7f47881604e0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient(hunting): picked mon.noname-a con 0x7f4788181fe0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47881649a0 con 0x7f4788181fe0 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4788164c80 con 0x7f478813e430 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4788180c20 con 0x7f47881604e0 2026-02-13T08:05:48.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient(hunting): authenticate will time out at 454.445515s 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478ca42640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f47881604e0 0x7f4788180510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40384/0 (socket says 10.20.193.104:40384) 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478da44640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f4788181fe0 0x7f478812bfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:41990/0 (socket says 10.20.193.104:41990) 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478ca42640 1 -- 10.20.193.104:0/3044489285 learned_addr learned my addr 10.20.193.104:0/3044489285 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 client.?.objecter ms_handle_connect 0x7f4788181fe0 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 client.?.objecter ms_handle_connect 0x7f47881604e0 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472028012 0 0) 0x7f47881649a0 con 0x7f4788181fe0 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): my global_id is 4263 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4758003620 con 0x7f4788181fe0 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944148518 0 0) 0x7f4788180c20 con 0x7f47881604e0 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): my global_id is 4250 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47881649a0 con 0x7f47881604e0 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3428211856 0 0) 0x7f4758003620 con 0x7f4788181fe0 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4788180c20 con 0x7f4788181fe0 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f47840036a0 con 0x7f4788181fe0 2026-02-13T08:05:48.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 client.?.objecter ms_handle_connect 0x7f478813e430 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3840781541 0 0) 0x7f47881649a0 con 0x7f47881604e0 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4758003620 con 0x7f47881604e0 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f477c0031d0 con 0x7f47881604e0 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.878 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3366054180 0 0) 0x7f4788180c20 con 0x7f4788181fe0 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 >> v1:10.20.193.104:6790/0 conn(0x7f47881604e0 legacy=0x7f4788180510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 >> v1:10.20.193.119:6789/0 conn(0x7f478813e430 legacy=0x7f478817fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 monclient: found mon.a 2026-02-13T08:05:48.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4788163e10 con 0x7f4788181fe0 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 5 monclient: authenticate success, global_id 4263 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: _renew_subs 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- 10.20.193.104:0/3044489285 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4788162920 con 0x7f4788181fe0 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 client.4263.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: _renew_subs 2026-02-13T08:05:48.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- 10.20.193.104:0/3044489285 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f47881636e0 con 0x7f4788181fe0 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 librados: init done 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4784003350 con 0x7f4788181fe0 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4784003e90 con 0x7f4788181fe0 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 monclient: dump: 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.881 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f47777fe640 4 set_mon_vals no callback set 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478f4ce640 1 -- 10.20.193.104:0/3044489285 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4788061860 con 0x7f4788181fe0 2026-02-13T08:05:48.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f4784004030 con 0x7f4788181fe0 2026-02-13T08:05:48.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f478404a420 con 0x7f4788181fe0 2026-02-13T08:05:48.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 client.4263.objecter ms_dispatch2 0x7f4788000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:48.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 3 client.4263.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:48.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 3 client.4263.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:48.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 20 client.4263.objecter dump_active .. 0 homeless 2026-02-13T08:05:48.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f478d243640 10 monclient: get_auth_request con 0x7f475803b8b0 auth_method 0 2026-02-13T08:05:48.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.852+0000 7f4775ffb640 10 client.4263.objecter ms_handle_connect 0x7f475803b8b0 2026-02-13T08:05:48.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.856+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f4784016e60 con 0x7f4788181fe0 2026-02-13T08:05:48.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.856+0000 7f4775ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:48.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.856+0000 7f4775ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:48.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:48.946 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:48.946 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:48.946 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 1 -- 10.20.193.104:0/3044489285 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f478808f5f0 con 0x7f4788181fe0 2026-02-13T08:05:48.946 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f4775ffb640 1 -- 10.20.193.104:0/3044489285 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+10887 (unknown 3338201251 0 4059467632) 0x7f4784016760 con 0x7f4788181fe0 2026-02-13T08:05:48.946 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f4775ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:48.946 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f4775ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:48.946 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:48.947 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":18,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","created":"2026-02-13T08:05:35.908543+0000","modified":"2026-02-13T08:05:48.237266+0000","last_up_change":"2026-02-13T08:05:40.923658+0000","last_in_change":"2026-02-13T08:05:36.956118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T08:05:41.903600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T08:05:44.705774+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"460b851b-aaa4-48d1-a60f-7c4d57195f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6808","nonce":1354850314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6809","nonce":1354850314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6811","nonce":1354850314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6810","nonce":1354850314}]},"public_addr":"10.20.193.104:6808/1354850314","cluster_addr":"10.20.193.104:6809/1354850314","heartbeat_back_addr":"10.20.193.104:6811/1354850314","heartbeat_front_addr":"10.20.193.104:6810/1354850314","state":["exists","up"]},{"osd":1,"uuid":"b96ae2ae-1756-45e7-932c-2e09b469bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6804","nonce":3474406264}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6805","nonce":3474406264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6807","nonce":3474406264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6806","nonce":3474406264}]},"public_addr":"10.20.193.104:6804/3474406264","cluster_addr":"10.20.193.104:6805/3474406264","heartbeat_back_addr":"10.20.193.104:6807/3474406264","heartbeat_front_addr":"10.20.193.104:6806/3474406264","state":["exists","up"]},{"osd":2,"uuid":"1ae934c3-1aba-4596-abae-1b7697ebf029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6800","nonce":3938786817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6801","nonce":3938786817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6803","nonce":3938786817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6802","nonce":3938786817}]},"public_addr":"10.20.193.104:6800/3938786817","cluster_addr":"10.20.193.104:6801/3938786817","heartbeat_back_addr":"10.20.193.104:6803/3938786817","heartbeat_front_addr":"10.20.193.104:6802/3938786817","state":["exists","up"]},{"osd":3,"uuid":"029c49a7-88e6-439c-90f8-534c1b8e4056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6800","nonce":4283496532}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6801","nonce":4283496532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6803","nonce":4283496532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6802","nonce":4283496532}]},"public_addr":"10.20.193.119:6800/4283496532","cluster_addr":"10.20.193.119:6801/4283496532","heartbeat_back_addr":"10.20.193.119:6803/4283496532","heartbeat_front_addr":"10.20.193.119:6802/4283496532","state":["exists","up"]},{"osd":4,"uuid":"a8122973-739c-4b4b-a9f5-59eac5f15f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6808","nonce":1543069880}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6809","nonce":1543069880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6811","nonce":1543069880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6810","nonce":1543069880}]},"public_addr":"10.20.193.119:6808/1543069880","cluster_addr":"10.20.193.119:6809/1543069880","heartbeat_back_addr":"10.20.193.119:6811/1543069880","heartbeat_front_addr":"10.20.193.119:6810/1543069880","state":["exists","up"]},{"osd":5,"uuid":"8901cba8-49ff-4a2a-8f16-6b3db8eff80e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6804","nonce":527707922}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6805","nonce":527707922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6807","nonce":527707922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6806","nonce":527707922}]},"public_addr":"10.20.193.119:6804/527707922","cluster_addr":"10.20.193.119:6805/527707922","heartbeat_back_addr":"10.20.193.119:6807/527707922","heartbeat_front_addr":"10.20.193.119:6806/527707922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T08:05:48.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 10 librados: watch_flush enter 2026-02-13T08:05:48.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 10 librados: watch_flush exit 2026-02-13T08:05:48.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 20 client.4263.objecter shutdown clearing up homeless session... 2026-02-13T08:05:48.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 10 client.4263.objecter successfully canceled tick 2026-02-13T08:05:48.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 1 -- 10.20.193.104:0/3044489285 >> v1:10.20.193.119:6812/276487904 conn(0x7f475803b8b0 legacy=0x7f475805bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 10 monclient: shutdown 2026-02-13T08:05:48.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:48.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 1 -- 10.20.193.104:0/3044489285 >> v1:10.20.193.104:6789/0 conn(0x7f4788181fe0 legacy=0x7f478812bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:48.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 1 -- 10.20.193.104:0/3044489285 shutdown_connections 2026-02-13T08:05:48.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.936+0000 7f478f4ce640 1 -- 10.20.193.104:0/3044489285 >> 10.20.193.104:0/3044489285 conn(0x7f4788090a40 msgr2=0x7f47880585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:48.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.940+0000 7f478f4ce640 1 -- 10.20.193.104:0/3044489285 shutdown_connections 2026-02-13T08:05:48.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.940+0000 7f478f4ce640 1 -- 10.20.193.104:0/3044489285 wait complete. 2026-02-13T08:05:48.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:48.940+0000 7f478f4ce640 1 librados: shutdown 2026-02-13T08:05:48.956 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-13T08:05:48.957 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-13T08:05:48.958 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-13T08:05:48.958 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-13T08:05:48.958 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-13T08:05:48.959 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-13T08:05:49.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.012+0000 7f442dd81640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.012+0000 7f442dd81640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.012+0000 7f442dd81640 10 monclient: monmap: 2026-02-13T08:05:49.023 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.023 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.023 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.020006+0000 2026-02-13T08:05:49.023 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.020006+0000 2026-02-13T08:05:49.023 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.023 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.023 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.023 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.024 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.024 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: monmap: 2026-02-13T08:05:49.024 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.025 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.025 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.020220+0000 2026-02-13T08:05:49.025 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.020220+0000 2026-02-13T08:05:49.025 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.025 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.025 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.025 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.025 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.025 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: monmap: 2026-02-13T08:05:49.026 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.026 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.026 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.020309+0000 2026-02-13T08:05:49.026 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.020309+0000 2026-02-13T08:05:49.027 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.027 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.027 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.027 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.027 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.027 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 Processor -- start 2026-02-13T08:05:49.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- start start 2026-02-13T08:05:49.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: init 2026-02-13T08:05:49.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:49.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient(hunting): picked mon.noname-c con 0x7f4428143850 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient(hunting): picked mon.noname-a con 0x7f442808e360 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient(hunting): picked mon.noname-b con 0x7f44281861d0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442808e760 con 0x7f442808e360 2026-02-13T08:05:49.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4428089f30 con 0x7f4428143850 2026-02-13T08:05:49.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 Processor -- start 2026-02-13T08:05:49.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442808b5b0 con 0x7f44281861d0 2026-02-13T08:05:49.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient(hunting): authenticate will time out at 454.608749s 2026-02-13T08:05:49.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- start start 2026-02-13T08:05:49.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: init 2026-02-13T08:05:49.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4426ffd640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f442808e360 0x7f4428184ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42006/0 (socket says 10.20.193.104:42006) 2026-02-13T08:05:49.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4426ffd640 1 -- 10.20.193.104:0/2575229467 learned_addr learned my addr 10.20.193.104:0/2575229467 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4427fff640 1 --1- 10.20.193.104:0/2575229467 >> v1:10.20.193.104:6790/0 conn(0x7f44281861d0 0x7f44281a65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40396/0 (socket says 10.20.193.104:40396) 2026-02-13T08:05:49.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 Processor -- start 2026-02-13T08:05:49.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- start start 2026-02-13T08:05:49.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: init 2026-02-13T08:05:49.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 -- 10.20.193.104:0/2575229467 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 343676367 0 0) 0x7f442808e760 con 0x7f442808e360 2026-02-13T08:05:49.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient(hunting): my global_id is 4266 2026-02-13T08:05:49.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 -- 10.20.193.104:0/2575229467 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f440c003620 con 0x7f442808e360 2026-02-13T08:05:49.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 -- 10.20.193.104:0/2575229467 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2896944299 0 0) 0x7f442808b5b0 con 0x7f44281861d0 2026-02-13T08:05:49.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient(hunting): my global_id is 4253 2026-02-13T08:05:49.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 -- 10.20.193.104:0/2575229467 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f442808e760 con 0x7f44281861d0 2026-02-13T08:05:49.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:49.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient(hunting): picked mon.noname-c con 0x7fa758091740 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient(hunting): picked mon.noname-a con 0x7fa75813f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient(hunting): picked mon.noname-b con 0x7fa75813fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75808e5f0 con 0x7fa75813f870 2026-02-13T08:05:49.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75808e8d0 con 0x7fa758091740 2026-02-13T08:05:49.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75808ebb0 con 0x7fa75813fcd0 2026-02-13T08:05:49.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient(hunting): authenticate will time out at 454.609300s 2026-02-13T08:05:49.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:49.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient(hunting): picked mon.noname-b con 0x7f790408ec30 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 -- 10.20.193.104:0/2575229467 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2822068641 0 0) 0x7f442808e760 con 0x7f44281861d0 2026-02-13T08:05:49.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 -- 10.20.193.104:0/2575229467 >> v1:10.20.193.119:6789/0 conn(0x7f4428143850 legacy=0x7f4428143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 -- 10.20.193.104:0/2575229467 >> v1:10.20.193.104:6789/0 conn(0x7f442808e360 legacy=0x7f4428184ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient(hunting): picked mon.noname-a con 0x7f790408f710 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient(hunting): picked mon.noname-c con 0x7f790417fc40 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790408aa10 con 0x7f790408f710 2026-02-13T08:05:49.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa7567fc640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fa75813f870 0x7fa758180690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42014/0 (socket says 10.20.193.104:42014) 2026-02-13T08:05:49.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa7567fc640 1 -- 10.20.193.104:0/3510508610 learned_addr learned my addr 10.20.193.104:0/3510508610 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 monclient: found mon.noname-b 2026-02-13T08:05:49.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 -- 10.20.193.104:0/2575229467 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442808b890 con 0x7f44281861d0 2026-02-13T08:05:49.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 -- 10.20.193.104:0/2575229467 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f441c003180 con 0x7f44281861d0 2026-02-13T08:05:49.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:49.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790408b340 con 0x7f790417fc40 2026-02-13T08:05:49.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790408c350 con 0x7f790408ec30 2026-02-13T08:05:49.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient(hunting): authenticate will time out at 454.609359s 2026-02-13T08:05:49.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient: dump: 2026-02-13T08:05:49.040 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.040 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.040 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.040 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.041 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.041 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.041 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.041 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.041 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.041 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 5 monclient: authenticate success, global_id 4253 2026-02-13T08:05:49.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7902575640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f790408ec30 0x7f790408f000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40416/0 (socket says 10.20.193.104:40416) 2026-02-13T08:05:49.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7902575640 1 -- 10.20.193.104:0/3883030469 learned_addr learned my addr 10.20.193.104:0/3883030469 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 -- 10.20.193.104:0/2575229467 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f441c0033d0 con 0x7f44281861d0 2026-02-13T08:05:49.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 1 -- 10.20.193.104:0/2575229467 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f441c003790 con 0x7f44281861d0 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f44267fc640 10 monclient: dump: 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.043 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.044 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.044 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 4 set_mon_vals no callback set 2026-02-13T08:05:49.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 -- 10.20.193.104:0/3510508610 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322895169 0 0) 0x7fa75808e5f0 con 0x7fa75813f870 2026-02-13T08:05:49.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient(hunting): my global_id is 4269 2026-02-13T08:05:49.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 -- 10.20.193.104:0/3510508610 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa744003620 con 0x7fa75813f870 2026-02-13T08:05:49.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 -- 10.20.193.104:0/3510508610 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2454037361 0 0) 0x7fa75808ebb0 con 0x7fa75813fcd0 2026-02-13T08:05:49.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient(hunting): my global_id is 4256 2026-02-13T08:05:49.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 -- 10.20.193.104:0/3510508610 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa75808e5f0 con 0x7fa75813fcd0 2026-02-13T08:05:49.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 -- 10.20.193.104:0/3883030469 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 562540738 0 0) 0x7f78ec002920 con 0x7f790408f710 2026-02-13T08:05:49.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient(hunting): my global_id is 4272 2026-02-13T08:05:49.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 -- 10.20.193.104:0/3883030469 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78f0003620 con 0x7f790408f710 2026-02-13T08:05:49.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 -- 10.20.193.104:0/3883030469 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3203573555 0 0) 0x7f790408c350 con 0x7f790408ec30 2026-02-13T08:05:49.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 -- 10.20.193.104:0/3510508610 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2317648432 0 0) 0x7fa744003620 con 0x7fa75813f870 2026-02-13T08:05:49.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 -- 10.20.193.104:0/3510508610 >> v1:10.20.193.104:6790/0 conn(0x7fa75813fcd0 legacy=0x7fa7581a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient(hunting): my global_id is 4259 2026-02-13T08:05:49.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 -- 10.20.193.104:0/3883030469 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78ec002920 con 0x7f790408ec30 2026-02-13T08:05:49.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 -- 10.20.193.104:0/3510508610 >> v1:10.20.193.119:6789/0 conn(0x7fa758091740 legacy=0x7fa75813f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 monclient: found mon.noname-a 2026-02-13T08:05:49.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 -- 10.20.193.104:0/3510508610 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa758091b10 con 0x7fa75813f870 2026-02-13T08:05:49.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 -- 10.20.193.104:0/3510508610 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa740002e00 con 0x7fa75813f870 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 5 monclient: authenticate success, global_id 4269 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient: dump: 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.050 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.051 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.051 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.051 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: shutdown 2026-02-13T08:05:49.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- 10.20.193.104:0/2575229467 >> v1:10.20.193.104:6790/0 conn(0x7f44281861d0 legacy=0x7f44281a65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 -- 10.20.193.104:0/3510508610 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa740003010 con 0x7fa75813f870 2026-02-13T08:05:49.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 1 -- 10.20.193.104:0/3510508610 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa740003450 con 0x7fa75813f870 2026-02-13T08:05:49.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 4 set_mon_vals no callback set 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa755ffb640 10 monclient: dump: 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.053 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- 10.20.193.104:0/2575229467 shutdown_connections 2026-02-13T08:05:49.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- 10.20.193.104:0/2575229467 >> 10.20.193.104:0/2575229467 conn(0x7f4428051a50 msgr2=0x7f4428051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 -- 10.20.193.104:0/3883030469 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3815865498 0 0) 0x7f78f0003620 con 0x7f790408f710 2026-02-13T08:05:49.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 -- 10.20.193.104:0/3883030469 >> v1:10.20.193.104:6790/0 conn(0x7f790408ec30 legacy=0x7f790408f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 -- 10.20.193.104:0/3883030469 >> v1:10.20.193.119:6789/0 conn(0x7f790417fc40 legacy=0x7f79041a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 monclient: found mon.noname-a 2026-02-13T08:05:49.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 -- 10.20.193.104:0/3883030469 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790408a790 con 0x7f790408f710 2026-02-13T08:05:49.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 -- 10.20.193.104:0/3883030469 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f78ec002fd0 con 0x7f790408f710 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient: dump: 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.056 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- 10.20.193.104:0/2575229467 shutdown_connections 2026-02-13T08:05:49.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 5 monclient: authenticate success, global_id 4272 2026-02-13T08:05:49.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- 10.20.193.104:0/2575229467 wait complete. 2026-02-13T08:05:49.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 -- 10.20.193.104:0/3883030469 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78ec0031a0 con 0x7f790408f710 2026-02-13T08:05:49.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 1 -- 10.20.193.104:0/3883030469 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f78ec0035b0 con 0x7f790408f710 2026-02-13T08:05:49.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901573640 10 monclient: dump: 2026-02-13T08:05:49.058 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.058 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.058 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.059 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.059 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.059 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.059 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.059 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.059 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.059 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 4 set_mon_vals no callback set 2026-02-13T08:05:49.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: shutdown 2026-02-13T08:05:49.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- 10.20.193.104:0/3510508610 >> v1:10.20.193.104:6789/0 conn(0x7fa75813f870 legacy=0x7fa758180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- 10.20.193.104:0/3510508610 shutdown_connections 2026-02-13T08:05:49.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- 10.20.193.104:0/3510508610 >> 10.20.193.104:0/3510508610 conn(0x7fa758090810 msgr2=0x7fa758090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: monmap: 2026-02-13T08:05:49.060 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.060 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.061 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.061 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.061 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.061 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.061 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.061 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.061 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.061 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- 10.20.193.104:0/3510508610 shutdown_connections 2026-02-13T08:05:49.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- 10.20.193.104:0/3510508610 wait complete. 2026-02-13T08:05:49.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: shutdown 2026-02-13T08:05:49.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- 10.20.193.104:0/3883030469 >> v1:10.20.193.104:6789/0 conn(0x7f790408f710 legacy=0x7f790417e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 librados: starting msgr at 2026-02-13T08:05:49.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 librados: starting objecter 2026-02-13T08:05:49.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- 10.20.193.104:0/3883030469 shutdown_connections 2026-02-13T08:05:49.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- 10.20.193.104:0/3883030469 >> 10.20.193.104:0/3883030469 conn(0x7f790408c820 msgr2=0x7f790408cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 Processor -- start 2026-02-13T08:05:49.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- 10.20.193.104:0/3883030469 shutdown_connections 2026-02-13T08:05:49.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- 10.20.193.104:0/3883030469 wait complete. 2026-02-13T08:05:49.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- start start 2026-02-13T08:05:49.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 librados: setting wanted keys 2026-02-13T08:05:49.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 librados: calling monclient init 2026-02-13T08:05:49.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: init 2026-02-13T08:05:49.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: monmap: 2026-02-13T08:05:49.064 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 librados: starting msgr at 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 librados: starting objecter 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 Processor -- start 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- start start 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 librados: setting wanted keys 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 librados: calling monclient init 2026-02-13T08:05:49.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: init 2026-02-13T08:05:49.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:49.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient(hunting): picked mon.noname-b con 0x7f442808e360 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient(hunting): picked mon.noname-c con 0x7f4428143850 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient(hunting): picked mon.noname-a con 0x7f44281861d0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442805a8d0 con 0x7f44281861d0 2026-02-13T08:05:49.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4428143340 con 0x7f442808e360 2026-02-13T08:05:49.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4428086620 con 0x7f4428143850 2026-02-13T08:05:49.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient(hunting): authenticate will time out at 454.611013s 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: monmap: 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.067 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4427fff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f44281861d0 0x7f4428185ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42024/0 (socket says 10.20.193.104:42024) 2026-02-13T08:05:49.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4426ffd640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f4428143850 0x7f4428059520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40432/0 (socket says 10.20.193.104:40432) 2026-02-13T08:05:49.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4427fff640 1 -- 10.20.193.104:0/3971645235 learned_addr learned my addr 10.20.193.104:0/3971645235 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 client.?.objecter ms_handle_connect 0x7f44281861d0 2026-02-13T08:05:49.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 client.?.objecter ms_handle_connect 0x7f4428143850 2026-02-13T08:05:49.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:49.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 librados: starting msgr at 2026-02-13T08:05:49.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 librados: starting objecter 2026-02-13T08:05:49.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient(hunting): picked mon.noname-a con 0x7fa758091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient(hunting): picked mon.noname-b con 0x7fa75813f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631495822 0 0) 0x7f4428086620 con 0x7f4428143850 2026-02-13T08:05:49.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): my global_id is 4262 2026-02-13T08:05:49.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient(hunting): picked mon.noname-c con 0x7fa75813fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa758058d50 con 0x7fa758091740 2026-02-13T08:05:49.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa758150580 con 0x7fa75813f870 2026-02-13T08:05:49.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa75808acb0 con 0x7fa75813fcd0 2026-02-13T08:05:49.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient(hunting): authenticate will time out at 454.611223s 2026-02-13T08:05:49.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43f8003620 con 0x7f4428143850 2026-02-13T08:05:49.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 Processor -- start 2026-02-13T08:05:49.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3443371306 0 0) 0x7f442805a8d0 con 0x7f44281861d0 2026-02-13T08:05:49.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): my global_id is 4275 2026-02-13T08:05:49.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4428086620 con 0x7f44281861d0 2026-02-13T08:05:49.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- start start 2026-02-13T08:05:49.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 librados: setting wanted keys 2026-02-13T08:05:49.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 librados: calling monclient init 2026-02-13T08:05:49.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa7577fe640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fa75813fcd0 0x7fa758191be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40440/0 (socket says 10.20.193.104:40440) 2026-02-13T08:05:49.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa7577fe640 1 -- 10.20.193.104:0/4280811967 learned_addr learned my addr 10.20.193.104:0/4280811967 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: init 2026-02-13T08:05:49.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1551933929 0 0) 0x7f43f8003620 con 0x7f4428143850 2026-02-13T08:05:49.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f442805a8d0 con 0x7f4428143850 2026-02-13T08:05:49.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4418003030 con 0x7f4428143850 2026-02-13T08:05:49.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): dump: 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 client.?.objecter ms_handle_connect 0x7fa758091740 2026-02-13T08:05:49.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 client.?.objecter ms_handle_connect 0x7fa75813fcd0 2026-02-13T08:05:49.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2087954275 0 0) 0x7f442805a8d0 con 0x7f4428143850 2026-02-13T08:05:49.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3266860042 0 0) 0x7fa75808acb0 con 0x7fa75813fcd0 2026-02-13T08:05:49.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 >> v1:10.20.193.119:6789/0 conn(0x7f442808e360 legacy=0x7f4428058e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): my global_id is 4265 2026-02-13T08:05:49.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa728003620 con 0x7fa75813fcd0 2026-02-13T08:05:49.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 client.?.objecter ms_handle_connect 0x7fa75813f870 2026-02-13T08:05:49.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493487469 0 0) 0x7fa758058d50 con 0x7fa758091740 2026-02-13T08:05:49.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 >> v1:10.20.193.104:6789/0 conn(0x7f44281861d0 legacy=0x7f4428185ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): my global_id is 4278 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa75808acb0 con 0x7fa758091740 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 monclient: found mon.c 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442805c390 con 0x7f4428143850 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 client.?.objecter ms_handle_connect 0x7f442808e360 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:49.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient(hunting): picked mon.noname-b con 0x7f790408ec30 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient(hunting): picked mon.noname-c con 0x7f790408f710 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 5 monclient: authenticate success, global_id 4262 2026-02-13T08:05:49.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: _renew_subs 2026-02-13T08:05:49.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- 10.20.193.104:0/3971645235 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f442805c6d0 con 0x7f4428143850 2026-02-13T08:05:49.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient(hunting): picked mon.noname-a con 0x7f790417fc40 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79041264e0 con 0x7f790417fc40 2026-02-13T08:05:49.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790410d730 con 0x7f790408ec30 2026-02-13T08:05:49.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790410c8c0 con 0x7f790408f710 2026-02-13T08:05:49.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7908f5d640 10 monclient(hunting): authenticate will time out at 454.611580s 2026-02-13T08:05:49.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 client.4262.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: _renew_subs 2026-02-13T08:05:49.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- 10.20.193.104:0/3971645235 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4428113b00 con 0x7f4428143850 2026-02-13T08:05:49.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 librados: init done 2026-02-13T08:05:49.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901d74640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f790408f710 0x7f790416d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40446/0 (socket says 10.20.193.104:40446) 2026-02-13T08:05:49.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f7901d74640 1 -- 10.20.193.104:0/189502665 learned_addr learned my addr 10.20.193.104:0/189502665 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435340988 0 0) 0x7fa758150580 con 0x7fa75813f870 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): my global_id is 4252 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa758058d50 con 0x7fa75813f870 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1526204159 0 0) 0x7fa728003620 con 0x7fa75813fcd0 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa758150580 con 0x7fa75813fcd0 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa748003480 con 0x7fa75813fcd0 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 client.?.objecter ms_handle_connect 0x7f790408f710 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 client.?.objecter ms_handle_connect 0x7f790417fc40 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): dump: 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.079 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44180031d0 con 0x7f4428143850 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4418004a80 con 0x7f4428143850 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4425ffb640 4 set_mon_vals no callback set 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f4403fff640 10 monclient: dump: 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3714047766 0 0) 0x7fa75808acb0 con 0x7fa758091740 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa728003620 con 0x7fa758091740 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa74c003020 con 0x7fa758091740 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): dump: 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2076057961 0 0) 0x7f79041264e0 con 0x7f790417fc40 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 monclient(hunting): my global_id is 4281 2026-02-13T08:05:49.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78d0003620 con 0x7f790417fc40 2026-02-13T08:05:49.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 client.4262.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 15 client.4262.objecter _session_command_op_assign -1 1 2026-02-13T08:05:49.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 20 client.4262.objecter _get_session osd=-1 returning homeless 2026-02-13T08:05:49.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 client.4262.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f442dd81640 1 -- 10.20.193.104:0/3971645235 --> v1:10.20.193.104:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f44281a7cd0 con 0x7f4428143850 2026-02-13T08:05:49.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3280257230 0 0) 0x7fa758058d50 con 0x7fa75813f870 2026-02-13T08:05:49.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa75808acb0 con 0x7fa75813f870 2026-02-13T08:05:49.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa740003360 con 0x7fa75813f870 2026-02-13T08:05:49.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient(hunting): dump: 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3568587390 0 0) 0x7fa728003620 con 0x7fa758091740 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 >> v1:10.20.193.104:6790/0 conn(0x7fa75813fcd0 legacy=0x7fa758191be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 >> v1:10.20.193.119:6789/0 conn(0x7fa75813f870 legacy=0x7fa75814fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 monclient: found mon.a 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75812dc60 con 0x7fa758091740 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa72ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 5 monclient: authenticate success, global_id 4278 2026-02-13T08:05:49.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: _renew_subs 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829082348 0 0) 0x7f790410c8c0 con 0x7f790408f710 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa75812e820 con 0x7fa758091740 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 10 monclient(hunting): my global_id is 4268 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79041264e0 con 0x7f790408f710 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 client.4278.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: _renew_subs 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa75813f580 con 0x7fa758091740 2026-02-13T08:05:49.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.016+0000 7fa75d9bc640 1 librados: init done 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 client.?.objecter ms_handle_connect 0x7f790408ec30 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3521877529 0 0) 0x7f78d0003620 con 0x7f790417fc40 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f790410c8c0 con 0x7f790417fc40 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f78f40033a0 con 0x7f790417fc40 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient(hunting): dump: 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa74c003230 con 0x7fa758091740 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa74c003580 con 0x7fa758091740 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa7557fa640 4 set_mon_vals no callback set 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 monclient: dump: 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.087 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2616729841 0 0) 0x7f79041264e0 con 0x7f790408f710 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78d0003620 con 0x7f790408f710 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f78ec002ee0 con 0x7f790408f710 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient(hunting): dump: 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839973218 0 0) 0x7f790410d730 con 0x7f790408ec30 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient(hunting): my global_id is 4255 2026-02-13T08:05:49.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79041264e0 con 0x7f790408ec30 2026-02-13T08:05:49.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f4418010a90 con 0x7f4428143850 2026-02-13T08:05:49.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1280773961 0 0) 0x7f790410c8c0 con 0x7f790417fc40 2026-02-13T08:05:49.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 >> v1:10.20.193.104:6790/0 conn(0x7f790408f710 legacy=0x7f790416d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa75d9bc640 10 client.4278.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa75d9bc640 15 client.4278.objecter _session_command_op_assign -1 1 2026-02-13T08:05:49.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa75d9bc640 20 client.4278.objecter _get_session osd=-1 returning homeless 2026-02-13T08:05:49.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa75d9bc640 10 client.4278.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa75d9bc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa75d9bc640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.104:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa758061860 con 0x7fa758091740 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 >> v1:10.20.193.119:6789/0 conn(0x7f790408ec30 legacy=0x7f7904125dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 monclient: found mon.a 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790410b3d0 con 0x7f790417fc40 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 5 monclient: authenticate success, global_id 4281 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 10 monclient: _renew_subs 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 1 -- 10.20.193.104:0/189502665 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f790410ce90 con 0x7f790417fc40 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 10 client.4281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 10 monclient: _renew_subs 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 1 -- 10.20.193.104:0/189502665 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f790410c100 con 0x7f790417fc40 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 1 librados: init done 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f441804a0c0 con 0x7f4428143850 2026-02-13T08:05:49.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 10 client.4262.objecter ms_dispatch2 0x7f4428000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 3 client.4262.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 3 client.4262.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78f4003540 con 0x7f790417fc40 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f78f4003ba0 con 0x7f790417fc40 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient: dump: 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7900d72640 4 set_mon_vals no callback set 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 10 client.4262.objecter checking command 1 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 20 client.4262.objecter _get_session s=0x7f43f805fad0 osd=2 3 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 20 client.4262.objecter put_session s=0x7f43f805fad0 osd=2 3 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 15 client.4262.objecter _session_command_op_remove -1 1 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 20 client.4262.objecter _get_session s=0x7f43f805fad0 osd=2 3 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 20 client.4262.objecter get_session s=0x7f43f805fad0 osd=2 3 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 15 client.4262.objecter _session_command_op_assign 2 1 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 20 client.4262.objecter put_session s=0x7f43f805fad0 osd=2 4 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 10 client.4262.objecter _send_command 1 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 --> v1:10.20.193.104:6800/3938786817 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43f8081e20 con 0x7f43f8060180 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 20 client.4262.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f441804a4e0 con 0x7f4428143850 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fa74c003580 con 0x7fa758091740 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f44277fe640 10 monclient: get_auth_request con 0x7f43f803b550 auth_method 0 2026-02-13T08:05:49.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4427fff640 10 monclient: get_auth_request con 0x7f43f8060180 auth_method 0 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: monmap: 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.024724+0000 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.024724+0000 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 10 client.4281.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 15 client.4281.objecter _session_command_op_assign -1 1 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 20 client.4281.objecter _get_session osd=-1 returning homeless 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 10 client.4281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7908f5d640 1 -- 10.20.193.104:0/189502665 --> v1:10.20.193.104:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f790410ae00 con 0x7f790417fc40 2026-02-13T08:05:49.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 10 client.4262.objecter ms_handle_connect 0x7f43f8060180 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7fa74c048d00 con 0x7fa758091740 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 client.4278.objecter ms_dispatch2 0x7fa758000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 3 client.4278.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 3 client.4278.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 10 client.4262.objecter ms_handle_connect 0x7f43f803b550 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 client.4278.objecter checking command 1 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 20 client.4278.objecter _get_session s=0x7fa7280600d0 osd=1 3 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 20 client.4278.objecter put_session s=0x7fa7280600d0 osd=1 3 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 15 client.4278.objecter _session_command_op_remove -1 1 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 20 client.4278.objecter _get_session s=0x7fa7280600d0 osd=1 3 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 20 client.4278.objecter get_session s=0x7fa7280600d0 osd=1 3 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 15 client.4278.objecter _session_command_op_assign 1 1 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 20 client.4278.objecter put_session s=0x7fa7280600d0 osd=1 4 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 client.4278.objecter _send_command 1 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.104:6804/3474406264 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa728082400 con 0x7fa728060780 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 20 client.4278.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7fa74c049110 con 0x7fa758091740 2026-02-13T08:05:49.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T08:05:49.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f78f4003d40 con 0x7f790417fc40 2026-02-13T08:05:49.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 Processor -- start 2026-02-13T08:05:49.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa7567fc640 10 monclient: get_auth_request con 0x7fa72803bc20 auth_method 0 2026-02-13T08:05:49.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa7577fe640 10 monclient: get_auth_request con 0x7fa728060780 auth_method 0 2026-02-13T08:05:49.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- start start 2026-02-13T08:05:49.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: init 2026-02-13T08:05:49.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 client.4278.objecter ms_handle_connect 0x7fa728060780 2026-02-13T08:05:49.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f78f4049340 con 0x7f790417fc40 2026-02-13T08:05:49.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 client.4281.objecter ms_dispatch2 0x7f7904000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 3 client.4281.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 3 client.4281.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== osd.2 v1:10.20.193.104:6800/3938786817 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f43f8081e20 con 0x7f43f8060180 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 10 client.4262.objecter ms_dispatch2 0x7f4428000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 10 client.4262.objecter _finish_command 1 = system:0 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 20 client.4262.objecter put_session s=0x7f43f805fad0 osd=2 4 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f4403fff640 15 client.4262.objecter _session_command_op_remove 2 1 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 client.4278.objecter ms_handle_connect 0x7fa72803bc20 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 client.4281.objecter checking command 1 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 20 client.4281.objecter _get_session s=0x7f78d005ff90 osd=5 3 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 20 client.4281.objecter put_session s=0x7f78d005ff90 osd=5 3 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 15 client.4281.objecter _session_command_op_remove -1 1 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 20 client.4281.objecter _get_session s=0x7f78d005ff90 osd=5 3 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 20 client.4281.objecter get_session s=0x7f78d005ff90 osd=5 3 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 15 client.4281.objecter _session_command_op_assign 5 1 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 20 client.4281.objecter put_session s=0x7f78d005ff90 osd=5 4 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 client.4281.objecter _send_command 1 2026-02-13T08:05:49.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 --> v1:10.20.193.119:6804/527707922 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f78d00822e0 con 0x7f78d0060640 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 20 client.4281.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f78f40496c0 con 0x7f790417fc40 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient(hunting): picked mon.noname-a con 0x7f678c091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient(hunting): picked mon.noname-c con 0x7f678c13f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient(hunting): picked mon.noname-b con 0x7f678c13fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c08e5f0 con 0x7f678c091740 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c08e8d0 con 0x7f678c13f870 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c08ebb0 con 0x7f678c13fcd0 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7902575640 10 monclient: get_auth_request con 0x7f78d003ba60 auth_method 0 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient(hunting): authenticate will time out at 454.613474s 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f67914cf640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f678c091740 0x7f678c13f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42046/0 (socket says 10.20.193.104:42046) 2026-02-13T08:05:49.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f67914cf640 1 -- 10.20.193.104:0/873938172 learned_addr learned my addr 10.20.193.104:0/873938172 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f7901d74640 10 monclient: get_auth_request con 0x7f78d0060640 auth_method 0 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 -- 10.20.193.104:0/873938172 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719388377 0 0) 0x7f678c08e5f0 con 0x7f678c091740 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== osd.1 v1:10.20.193.104:6804/3474406264 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fa728082400 con 0x7fa728060780 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 client.4278.objecter ms_dispatch2 0x7fa758000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 10 client.4278.objecter _finish_command 1 = system:0 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 20 client.4278.objecter put_session s=0x7fa7280600d0 osd=1 4 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7fa72ffff640 15 client.4278.objecter _session_command_op_remove 1 1 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient(hunting): my global_id is 4284 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 -- 10.20.193.104:0/873938172 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6774003620 con 0x7f678c091740 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 -- 10.20.193.104:0/873938172 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2954286040 0 0) 0x7f678c08ebb0 con 0x7f678c13fcd0 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient(hunting): my global_id is 4271 2026-02-13T08:05:49.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 -- 10.20.193.104:0/873938172 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f678c08e5f0 con 0x7f678c13fcd0 2026-02-13T08:05:49.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 client.4281.objecter ms_handle_connect 0x7f78d003ba60 2026-02-13T08:05:49.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 client.4281.objecter ms_handle_connect 0x7f78d0060640 2026-02-13T08:05:49.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 -- 10.20.193.104:0/873938172 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 984657801 0 0) 0x7f6774003620 con 0x7f678c091740 2026-02-13T08:05:49.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 -- 10.20.193.104:0/873938172 >> v1:10.20.193.104:6790/0 conn(0x7f678c13fcd0 legacy=0x7f678c1a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 -- 10.20.193.104:0/873938172 >> v1:10.20.193.119:6789/0 conn(0x7f678c13f870 legacy=0x7f678c180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 monclient: found mon.noname-a 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 -- 10.20.193.104:0/873938172 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678c091b10 con 0x7f678c091740 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 -- 10.20.193.104:0/873938172 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f677c002e00 con 0x7f678c091740 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient: dump: 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 5 monclient: authenticate success, global_id 4284 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 -- 10.20.193.104:0/873938172 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f677c003050 con 0x7f678c091740 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 1 -- 10.20.193.104:0/873938172 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f677c003490 con 0x7f678c091740 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677bfff640 10 monclient: dump: 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.100 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 4 set_mon_vals no callback set 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: shutdown 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- 10.20.193.104:0/873938172 >> v1:10.20.193.104:6789/0 conn(0x7f678c091740 legacy=0x7f678c13f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- 10.20.193.104:0/873938172 shutdown_connections 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- 10.20.193.104:0/873938172 >> 10.20.193.104:0/873938172 conn(0x7f678c090810 msgr2=0x7f678c090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- 10.20.193.104:0/873938172 shutdown_connections 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- 10.20.193.104:0/873938172 wait complete. 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: monmap: 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== osd.5 v1:10.20.193.119:6804/527707922 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f78d00822e0 con 0x7f78d0060640 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 client.4281.objecter ms_dispatch2 0x7f7904000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 10 client.4281.objecter _finish_command 1 = system:0 2026-02-13T08:05:49.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 20 client.4281.objecter put_session s=0x7f78d005ff90 osd=5 4 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f78eaffd640 15 client.4281.objecter _session_command_op_remove 5 1 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 librados: starting msgr at 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 librados: starting objecter 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 10 monclient: monmap: 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.026804+0000 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.026804+0000 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 Processor -- start 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- start start 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 librados: setting wanted keys 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 librados: calling monclient init 2026-02-13T08:05:49.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: init 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 1 Processor -- start 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 1 -- start start 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 10 monclient: init 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient(hunting): picked mon.noname-a con 0x7f678c091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient(hunting): picked mon.noname-b con 0x7f678c13f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient(hunting): picked mon.noname-c con 0x7f678c13fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c13f630 con 0x7f678c091740 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c12cd80 con 0x7f678c13f870 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c12ee80 con 0x7f678c13fcd0 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient(hunting): authenticate will time out at 454.615291s 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f67914cf640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f678c091740 0x7f678c12bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42054/0 (socket says 10.20.193.104:42054) 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f67914cf640 1 -- 10.20.193.104:0/3267155268 learned_addr learned my addr 10.20.193.104:0/3267155268 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 client.?.objecter ms_handle_connect 0x7f678c091740 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 client.?.objecter ms_handle_connect 0x7f678c13fcd0 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727699223 0 0) 0x7f678c13f630 con 0x7f678c091740 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): my global_id is 4287 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 10 monclient(hunting): picked mon.noname-a con 0x7faa580869c0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 10 monclient(hunting): picked mon.noname-c con 0x7faa5813d8e0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f675c003620 con 0x7f678c091740 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395908162 0 0) 0x7f678c12ee80 con 0x7f678c13fcd0 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): my global_id is 4274 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f678c13f630 con 0x7f678c13fcd0 2026-02-13T08:05:49.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 10 monclient(hunting): picked mon.noname-b con 0x7faa5817f7e0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa5808db80 con 0x7faa580869c0 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa5808de60 con 0x7faa5813d8e0 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa58086110 con 0x7faa5817f7e0 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 10 monclient(hunting): authenticate will time out at 454.615521s 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa57fff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7faa580869c0 0x7faa5813d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42068/0 (socket says 10.20.193.104:42068) 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa57fff640 1 -- 10.20.193.104:0/3484063593 learned_addr learned my addr 10.20.193.104:0/3484063593 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5cb77640 1 --1- 10.20.193.104:0/3484063593 >> v1:10.20.193.104:6790/0 conn(0x7faa5817f7e0 0x7faa5819fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40484/0 (socket says 10.20.193.104:40484) 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 644314696 0 0) 0x7f675c003620 con 0x7f678c091740 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f678c12ee80 con 0x7f678c091740 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f677c0033a0 con 0x7f678c091740 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3300718536 0 0) 0x7f678c13f630 con 0x7f678c13fcd0 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f675c003620 con 0x7f678c13fcd0 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f67880033b0 con 0x7f678c13fcd0 2026-02-13T08:05:49.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 1 -- 10.20.193.104:0/3484063593 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168025057 0 0) 0x7faa58086110 con 0x7faa5817f7e0 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient(hunting): my global_id is 4277 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1389679146 0 0) 0x7f678c12ee80 con 0x7f678c091740 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 >> v1:10.20.193.104:6790/0 conn(0x7f678c13fcd0 legacy=0x7f678c1919d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 >> v1:10.20.193.119:6789/0 conn(0x7f678c13f870 legacy=0x7f678c12c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 1 -- 10.20.193.104:0/3484063593 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa3c003620 con 0x7faa5817f7e0 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 1 -- 10.20.193.104:0/3484063593 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803536879 0 0) 0x7faa5808db80 con 0x7faa580869c0 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient(hunting): my global_id is 4290 2026-02-13T08:05:49.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 1 -- 10.20.193.104:0/3484063593 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa58086110 con 0x7faa580869c0 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 monclient: found mon.a 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678c12d990 con 0x7f678c091740 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 5 monclient: authenticate success, global_id 4287 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: _renew_subs 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- 10.20.193.104:0/3267155268 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f678c12fcf0 con 0x7f678c091740 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: _renew_subs 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 -- 10.20.193.104:0/3267155268 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f678c08ab30 con 0x7f678c091740 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f679375a640 1 librados: init done 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 1 -- 10.20.193.104:0/3484063593 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1245472869 0 0) 0x7faa3c003620 con 0x7faa5817f7e0 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 1 -- 10.20.193.104:0/3484063593 >> v1:10.20.193.119:6789/0 conn(0x7faa5813d8e0 legacy=0x7faa5817e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 1 -- 10.20.193.104:0/3484063593 >> v1:10.20.193.104:6789/0 conn(0x7faa580869c0 legacy=0x7faa5813d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 1 monclient: found mon.noname-b 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 1 -- 10.20.193.104:0/3484063593 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa58091260 con 0x7faa5817f7e0 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 1 -- 10.20.193.104:0/3484063593 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7faa4c003180 con 0x7faa5817f7e0 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 5 monclient: authenticate success, global_id 4277 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f677c003030 con 0x7f678c091740 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f677c004cf0 con 0x7f678c091740 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f677b7fe640 4 set_mon_vals no callback set 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7f6779ffb640 10 monclient: dump: 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.108 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa56ffd640 10 monclient: dump: 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.020+0000 7faa5e601640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa56ffd640 1 -- 10.20.193.104:0/3484063593 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faa4c0033c0 con 0x7faa5817f7e0 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa56ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa56ffd640 1 -- 10.20.193.104:0/3484063593 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7faa4c003800 con 0x7faa5817f7e0 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa56ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa56ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa56ffd640 10 monclient: dump: 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 4 set_mon_vals no callback set 2026-02-13T08:05:49.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f679375a640 10 client.4287.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f679375a640 15 client.4287.objecter _session_command_op_assign -1 1 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f679375a640 20 client.4287.objecter _get_session osd=-1 returning homeless 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f679375a640 10 client.4287.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f679375a640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f679375a640 1 -- 10.20.193.104:0/3267155268 --> v1:10.20.193.104:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f678c12f930 con 0x7f678c091740 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f677c010d00 con 0x7f678c091740 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: shutdown 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- 10.20.193.104:0/3484063593 >> v1:10.20.193.104:6790/0 conn(0x7faa5817f7e0 legacy=0x7faa5819fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- 10.20.193.104:0/3484063593 shutdown_connections 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- 10.20.193.104:0/3484063593 >> 10.20.193.104:0/3484063593 conn(0x7faa5808e1d0 msgr2=0x7faa5808e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- 10.20.193.104:0/3484063593 shutdown_connections 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- 10.20.193.104:0/3484063593 wait complete. 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f677c04a280 con 0x7f678c091740 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 10 client.4287.objecter ms_dispatch2 0x7f678c000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 3 client.4287.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 3 client.4287.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 10 client.4287.objecter checking command 1 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 20 client.4287.objecter _get_session s=0x7f675c05fc50 osd=4 3 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 20 client.4287.objecter put_session s=0x7f675c05fc50 osd=4 3 2026-02-13T08:05:49.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 15 client.4287.objecter _session_command_op_remove -1 1 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 20 client.4287.objecter _get_session s=0x7f675c05fc50 osd=4 3 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 20 client.4287.objecter get_session s=0x7f675c05fc50 osd=4 3 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 15 client.4287.objecter _session_command_op_assign 4 1 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 20 client.4287.objecter put_session s=0x7f675c05fc50 osd=4 4 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 10 client.4287.objecter _send_command 1 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 --> v1:10.20.193.119:6808/1543069880 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f675c081f00 con 0x7f675c060300 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 20 client.4287.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f677c04a690 con 0x7f678c091740 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6790cce640 10 monclient: get_auth_request con 0x7f675c03b7e0 auth_method 0 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6791cd0640 10 monclient: get_auth_request con 0x7f675c060300 auth_method 0 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: monmap: 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 10 client.4287.objecter ms_handle_connect 0x7f675c03b7e0 2026-02-13T08:05:49.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 10 client.4287.objecter ms_handle_connect 0x7f675c060300 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 librados: starting msgr at 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 librados: starting objecter 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 Processor -- start 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- start start 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 librados: setting wanted keys 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 librados: calling monclient init 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: init 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient(hunting): picked mon.noname-b con 0x7faa580869c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient(hunting): picked mon.noname-a con 0x7faa5813d8e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient: monmap: 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.029507+0000 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.029507+0000 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.112 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient(hunting): picked mon.noname-c con 0x7faa5817f7e0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa5805d410 con 0x7faa5813d8e0 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa5819c640 con 0x7faa580869c0 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa5808afa0 con 0x7faa5817f7e0 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient(hunting): authenticate will time out at 454.617544s 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa577fe640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7faa5813d8e0 0x7faa5805cd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42070/0 (socket says 10.20.193.104:42070) 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5cb77640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7faa5817f7e0 0x7faa5817eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40500/0 (socket says 10.20.193.104:40500) 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa577fe640 1 -- 10.20.193.104:0/1009175895 learned_addr learned my addr 10.20.193.104:0/1009175895 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 client.?.objecter ms_handle_connect 0x7faa5817f7e0 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 client.?.objecter ms_handle_connect 0x7faa5813d8e0 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1034372514 0 0) 0x7faa5808afa0 con 0x7faa5817f7e0 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): my global_id is 4280 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa28003620 con 0x7faa5817f7e0 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485086748 0 0) 0x7faa5805d410 con 0x7faa5813d8e0 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== osd.4 v1:10.20.193.119:6808/1543069880 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f675c081f00 con 0x7f675c060300 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 10 client.4287.objecter ms_dispatch2 0x7f678c000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 10 client.4287.objecter _finish_command 1 = system:0 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): my global_id is 4293 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa5808afa0 con 0x7faa5813d8e0 2026-02-13T08:05:49.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 20 client.4287.objecter put_session s=0x7f675c05fc50 osd=4 4 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f6779ffb640 15 client.4287.objecter _session_command_op_remove 4 1 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 Processor -- start 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 client.?.objecter ms_handle_connect 0x7faa580869c0 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 -- start start 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient: init 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 149372288 0 0) 0x7faa28003620 con 0x7faa5817f7e0 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa5805d410 con 0x7faa5817f7e0 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7faa4c003710 con 0x7faa5817f7e0 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:49.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): dump: 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2727047719 0 0) 0x7faa5808afa0 con 0x7faa5813d8e0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa28003620 con 0x7faa5813d8e0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7faa48003050 con 0x7faa5813d8e0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): dump: 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2494219535 0 0) 0x7faa5819c640 con 0x7faa580869c0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient(hunting): my global_id is 4261 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa5808afa0 con 0x7faa580869c0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1461274267 0 0) 0x7faa5805d410 con 0x7faa5817f7e0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 >> v1:10.20.193.119:6789/0 conn(0x7faa580869c0 legacy=0x7faa5805c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 >> v1:10.20.193.104:6789/0 conn(0x7faa5813d8e0 legacy=0x7faa5805cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 monclient: found mon.c 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa580893e0 con 0x7faa5817f7e0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 5 monclient: authenticate success, global_id 4280 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: _renew_subs 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- 10.20.193.104:0/1009175895 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faa5817f5b0 con 0x7faa5817f7e0 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 client.4280.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: _renew_subs 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- 10.20.193.104:0/1009175895 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7faa5819c360 con 0x7faa5817f7e0 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 librados: init done 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faa4c004fb0 con 0x7faa5817f7e0 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7faa4c005160 con 0x7faa5817f7e0 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa567fc640 4 set_mon_vals no callback set 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient: dump: 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient(hunting): picked mon.noname-c con 0x7f5c3c091740 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient(hunting): picked mon.noname-a con 0x7f5c3c13f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient(hunting): picked mon.noname-b con 0x7f5c3c13fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3c08e5f0 con 0x7f5c3c13f870 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3c08e8d0 con 0x7f5c3c091740 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3c08ebb0 con 0x7f5c3c13fcd0 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient(hunting): authenticate will time out at 454.618351s 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c42af8640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f5c3c13fcd0 0x7f5c3c1a1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40512/0 (socket says 10.20.193.104:40512) 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c41af6640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f5c3c13f870 0x7f5c3c180690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42074/0 (socket says 10.20.193.104:42074) 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 client.4280.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 15 client.4280.objecter _session_command_op_assign -1 1 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 20 client.4280.objecter _get_session osd=-1 returning homeless 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 client.4280.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa5e601640 1 -- 10.20.193.104:0/1009175895 --> v1:10.20.193.104:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7faa58090d80 con 0x7faa5817f7e0 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c42af8640 1 -- 10.20.193.104:0/1827762028 learned_addr learned my addr 10.20.193.104:0/1827762028 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564272808 0 0) 0x7f5c3c08e5f0 con 0x7f5c3c13f870 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): my global_id is 4296 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c24003620 con 0x7f5c3c13f870 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3887845698 0 0) 0x7f5c3c08ebb0 con 0x7f5c3c13fcd0 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7faa4c011170 con 0x7faa5817f7e0 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): my global_id is 4283 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c3c08e5f0 con 0x7f5c3c13fcd0 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 477468977 0 0) 0x7f5c3c08e8d0 con 0x7f5c3c091740 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient(hunting): my global_id is 4264 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c3c08ebb0 con 0x7f5c3c091740 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2056247182 0 0) 0x7f5c24003620 con 0x7f5c3c13f870 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 >> v1:10.20.193.104:6790/0 conn(0x7f5c3c13fcd0 legacy=0x7f5c3c1a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 >> v1:10.20.193.119:6789/0 conn(0x7f5c3c091740 legacy=0x7f5c3c13f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 monclient: found mon.noname-a 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7faa4c04a3e0 con 0x7faa5817f7e0 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 client.4280.objecter ms_dispatch2 0x7faa58000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 3 client.4280.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 3 client.4280.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c091b10 con 0x7f5c3c13f870 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5c30002e00 con 0x7f5c3c13f870 2026-02-13T08:05:49.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient: dump: 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 5 monclient: authenticate success, global_id 4296 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 client.4280.objecter checking command 1 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 20 client.4280.objecter _get_session s=0x7faa28060180 osd=3 3 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 20 client.4280.objecter put_session s=0x7faa28060180 osd=3 3 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 15 client.4280.objecter _session_command_op_remove -1 1 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 20 client.4280.objecter _get_session s=0x7faa28060180 osd=3 3 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 20 client.4280.objecter get_session s=0x7faa28060180 osd=3 3 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 15 client.4280.objecter _session_command_op_assign 3 1 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 20 client.4280.objecter put_session s=0x7faa28060180 osd=3 4 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 client.4280.objecter _send_command 1 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 --> v1:10.20.193.119:6800/4283496532 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa4c0033c0 con 0x7faa28060830 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 20 client.4280.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7faa4c04a770 con 0x7faa5817f7e0 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c30002fa0 con 0x7f5c3c13f870 2026-02-13T08:05:49.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 1 -- 10.20.193.104:0/1827762028 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5c300033e0 con 0x7f5c3c13f870 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c412f5640 10 monclient: dump: 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 4 set_mon_vals no callback set 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa577fe640 10 monclient: get_auth_request con 0x7faa28060830 auth_method 0 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient: shutdown 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 -- 10.20.193.104:0/1827762028 >> v1:10.20.193.104:6789/0 conn(0x7f5c3c13f870 legacy=0x7f5c3c180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 -- 10.20.193.104:0/1827762028 shutdown_connections 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 -- 10.20.193.104:0/1827762028 >> 10.20.193.104:0/1827762028 conn(0x7f5c3c090810 msgr2=0x7f5c3c090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7faa54ff9640 10 client.4280.objecter ms_handle_connect 0x7faa28060830 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 -- 10.20.193.104:0/1827762028 shutdown_connections 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 -- 10.20.193.104:0/1827762028 wait complete. 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient: monmap: 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 librados: starting msgr at 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 librados: starting objecter 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 Processor -- start 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 -- start start 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 librados: setting wanted keys 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 1 librados: calling monclient init 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.024+0000 7f5c44582640 10 monclient: init 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== osd.3 v1:10.20.193.119:6800/4283496532 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7faa4c0033c0 con 0x7faa28060830 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7faa54ff9640 10 client.4280.objecter ms_dispatch2 0x7faa58000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7faa54ff9640 10 client.4280.objecter _finish_command 1 = system:0 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7faa54ff9640 20 client.4280.objecter put_session s=0x7faa28060180 osd=3 4 2026-02-13T08:05:49.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7faa54ff9640 15 client.4280.objecter _session_command_op_remove 3 1 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient(hunting): picked mon.noname-a con 0x7f5c3c091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient(hunting): picked mon.noname-b con 0x7f5c3c13f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient(hunting): picked mon.noname-c con 0x7f5c3c13fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3c12fca0 con 0x7f5c3c091740 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3c12ccf0 con 0x7f5c3c13f870 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c3c08ab30 con 0x7f5c3c13fcd0 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient(hunting): authenticate will time out at 454.620339s 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c422f7640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f5c3c091740 0x7f5c3c12bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42080/0 (socket says 10.20.193.104:42080) 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c422f7640 1 -- 10.20.193.104:0/1564887464 learned_addr learned my addr 10.20.193.104:0/1564887464 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.?.objecter ms_handle_connect 0x7f5c3c091740 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.?.objecter ms_handle_connect 0x7f5c3c13fcd0 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508010135 0 0) 0x7f5c3c12fca0 con 0x7f5c3c091740 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): my global_id is 4299 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c0c003620 con 0x7f5c3c091740 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964118769 0 0) 0x7f5c3c08ab30 con 0x7f5c3c13fcd0 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): my global_id is 4286 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c3c12fca0 con 0x7f5c3c13fcd0 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3598950845 0 0) 0x7f5c0c003620 con 0x7f5c3c091740 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c3c08ab30 con 0x7f5c3c091740 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5c2c003180 con 0x7f5c3c091740 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): dump: 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.123 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.?.objecter ms_handle_connect 0x7f5c3c13f870 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1242118895 0 0) 0x7f5c3c12fca0 con 0x7f5c3c13fcd0 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c0c003620 con 0x7f5c3c13fcd0 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5c380033b0 con 0x7f5c3c13fcd0 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient(hunting): dump: 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2557969570 0 0) 0x7f5c3c08ab30 con 0x7f5c3c091740 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 >> v1:10.20.193.104:6790/0 conn(0x7f5c3c13fcd0 legacy=0x7f5c3c1917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 >> v1:10.20.193.119:6789/0 conn(0x7f5c3c13f870 legacy=0x7f5c3c12c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 monclient: found mon.a 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c12ee30 con 0x7f5c3c091740 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 5 monclient: authenticate success, global_id 4299 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient: _renew_subs 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 1 -- 10.20.193.104:0/1564887464 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3c12d940 con 0x7f5c3c091740 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 client.4299.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient: _renew_subs 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 1 -- 10.20.193.104:0/1564887464 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5c3c13f5e0 con 0x7f5c3c091740 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 1 librados: init done 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c2c0039c0 con 0x7f5c3c091740 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5c2c003dd0 con 0x7f5c3c091740 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c40af4640 4 set_mon_vals no callback set 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient: dump: 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 client.4299.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 15 client.4299.objecter _session_command_op_assign -1 1 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 20 client.4299.objecter _get_session osd=-1 returning homeless 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 client.4299.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c44582640 1 -- 10.20.193.104:0/1564887464 --> v1:10.20.193.104:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5c3c12e700 con 0x7f5c3c091740 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f5c2c003f70 con 0x7f5c3c091740 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f5c2c04a380 con 0x7f5c3c091740 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.4299.objecter ms_dispatch2 0x7f5c3c000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 3 client.4299.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 3 client.4299.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.4299.objecter checking command 1 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 20 client.4299.objecter _get_session s=0x7f5c0c05fee0 osd=0 3 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 20 client.4299.objecter put_session s=0x7f5c0c05fee0 osd=0 3 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 15 client.4299.objecter _session_command_op_remove -1 1 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 20 client.4299.objecter _get_session s=0x7f5c0c05fee0 osd=0 3 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 20 client.4299.objecter get_session s=0x7f5c0c05fee0 osd=0 3 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 15 client.4299.objecter _session_command_op_assign 0 1 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 20 client.4299.objecter put_session s=0x7f5c0c05fee0 osd=0 4 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.4299.objecter _send_command 1 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 --> v1:10.20.193.104:6808/1354850314 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c38003160 con 0x7f5c0c060590 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 20 client.4299.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f5c2c04a790 con 0x7f5c3c091740 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c42af8640 10 monclient: get_auth_request con 0x7f5c0c060590 auth_method 0 2026-02-13T08:05:49.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.4299.objecter ms_handle_connect 0x7f5c0c060590 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 10 client.4262.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 15 client.4262.objecter _session_command_op_assign -1 2 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 20 client.4262.objecter _get_session s=0x7f43f805fad0 osd=2 3 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 20 client.4262.objecter put_session s=0x7f43f805fad0 osd=2 3 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 20 client.4262.objecter _get_session s=0x7f43f805fad0 osd=2 3 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 15 client.4262.objecter _session_command_op_remove -1 2 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 20 client.4262.objecter get_session s=0x7f43f805fad0 osd=2 3 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 15 client.4262.objecter _session_command_op_assign 2 2 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 20 client.4262.objecter put_session s=0x7f43f805fad0 osd=2 4 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 10 client.4262.objecter _send_command 2 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 1 -- 10.20.193.104:0/3971645235 --> v1:10.20.193.104:6800/3938786817 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f44281a65b0 con 0x7f43f8060180 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== osd.0 v1:10.20.193.104:6808/1354850314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f5c38003160 con 0x7f5c0c060590 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.4299.objecter ms_dispatch2 0x7f5c3c000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 10 client.4299.objecter _finish_command 1 = system:0 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 20 client.4299.objecter put_session s=0x7f5c0c05fee0 osd=0 4 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f5c22ffd640 15 client.4299.objecter _session_command_op_remove 0 1 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f4403fff640 1 -- 10.20.193.104:0/3971645235 <== osd.2 v1:10.20.193.104:6800/3938786817 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f44281a65b0 con 0x7f43f8060180 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f4403fff640 10 client.4262.objecter ms_dispatch2 0x7f4428000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f4403fff640 10 client.4262.objecter _finish_command 2 = system:0 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f4403fff640 20 client.4262.objecter put_session s=0x7f43f805fad0 osd=2 4 2026-02-13T08:05:49.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f4403fff640 15 client.4262.objecter _session_command_op_remove 2 2 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 10 librados: watch_flush enter 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 10 librados: watch_flush exit 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 10 client.4262.objecter close_session for osd.2 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 1 -- 10.20.193.104:0/3971645235 >> v1:10.20.193.104:6800/3938786817 conn(0x7f43f8060180 legacy=0x7f43f80805b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 20 client.4262.objecter put_session s=0x7f43f805fad0 osd=2 1 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 20 client.4262.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 10 client.4262.objecter successfully canceled tick 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 1 -- 10.20.193.104:0/3971645235 >> v1:10.20.193.119:6812/276487904 conn(0x7f43f803b550 legacy=0x7f43f805ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 10 monclient: shutdown 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 1 -- 10.20.193.104:0/3971645235 >> v1:10.20.193.104:6790/0 conn(0x7f4428143850 legacy=0x7f4428059520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f4427fff640 1 -- 10.20.193.104:0/3971645235 reap_dead start 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 1 -- 10.20.193.104:0/3971645235 shutdown_connections 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 1 -- 10.20.193.104:0/3971645235 >> 10.20.193.104:0/3971645235 conn(0x7f4428051a50 msgr2=0x7f44281062e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 1 -- 10.20.193.104:0/3971645235 shutdown_connections 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 1 -- 10.20.193.104:0/3971645235 wait complete. 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f442dd81640 1 librados: shutdown 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 10 client.4278.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 15 client.4278.objecter _session_command_op_assign -1 2 2026-02-13T08:05:49.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 20 client.4278.objecter _get_session s=0x7fa7280600d0 osd=1 3 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 20 client.4278.objecter put_session s=0x7fa7280600d0 osd=1 3 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 20 client.4278.objecter _get_session s=0x7fa7280600d0 osd=1 3 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 15 client.4278.objecter _session_command_op_remove -1 2 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 20 client.4278.objecter get_session s=0x7fa7280600d0 osd=1 3 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 15 client.4278.objecter _session_command_op_assign 1 2 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 20 client.4278.objecter put_session s=0x7fa7280600d0 osd=1 4 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 10 client.4278.objecter _send_command 2 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 1 -- 10.20.193.104:0/4280811967 --> v1:10.20.193.104:6804/3474406264 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa75812d400 con 0x7fa728060780 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa72ffff640 1 -- 10.20.193.104:0/4280811967 <== osd.1 v1:10.20.193.104:6804/3474406264 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7fa75812d400 con 0x7fa728060780 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa72ffff640 10 client.4278.objecter ms_dispatch2 0x7fa758000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa72ffff640 10 client.4278.objecter _finish_command 2 = system:0 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa72ffff640 20 client.4278.objecter put_session s=0x7fa7280600d0 osd=1 4 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa72ffff640 15 client.4278.objecter _session_command_op_remove 1 2 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 10 librados: watch_flush enter 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 10 librados: watch_flush exit 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 10 client.4278.objecter close_session for osd.1 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 1 -- 10.20.193.104:0/4280811967 >> v1:10.20.193.104:6804/3474406264 conn(0x7fa728060780 legacy=0x7fa728080b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 20 client.4278.objecter put_session s=0x7fa7280600d0 osd=1 1 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 20 client.4278.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 10 client.4278.objecter successfully canceled tick 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 1 -- 10.20.193.104:0/4280811967 >> v1:10.20.193.119:6812/276487904 conn(0x7fa72803bc20 legacy=0x7fa72805c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 10 monclient: shutdown 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 1 -- 10.20.193.104:0/4280811967 >> v1:10.20.193.104:6789/0 conn(0x7fa758091740 legacy=0x7fa75814f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa7577fe640 1 -- 10.20.193.104:0/4280811967 reap_dead start 2026-02-13T08:05:49.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 1 -- 10.20.193.104:0/4280811967 shutdown_connections 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 1 -- 10.20.193.104:0/4280811967 >> 10.20.193.104:0/4280811967 conn(0x7fa758090810 msgr2=0x7fa75808d290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 1 -- 10.20.193.104:0/4280811967 shutdown_connections 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 1 -- 10.20.193.104:0/4280811967 wait complete. 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7fa75d9bc640 1 librados: shutdown 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f7908f5d640 10 client.4281.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f7908f5d640 15 client.4281.objecter _session_command_op_assign -1 2 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f7908f5d640 20 client.4281.objecter _get_session s=0x7f78d005ff90 osd=5 3 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f7908f5d640 20 client.4281.objecter put_session s=0x7f78d005ff90 osd=5 3 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f7908f5d640 20 client.4281.objecter _get_session s=0x7f78d005ff90 osd=5 3 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f7908f5d640 15 client.4281.objecter _session_command_op_remove -1 2 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f7908f5d640 20 client.4281.objecter get_session s=0x7f78d005ff90 osd=5 3 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f7908f5d640 15 client.4281.objecter _session_command_op_assign 5 2 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f7908f5d640 20 client.4281.objecter put_session s=0x7f78d005ff90 osd=5 4 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f7908f5d640 10 client.4281.objecter _send_command 2 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f7908f5d640 1 -- 10.20.193.104:0/189502665 --> v1:10.20.193.119:6804/527707922 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7904056c10 con 0x7f78d0060640 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f78eaffd640 1 -- 10.20.193.104:0/189502665 <== osd.5 v1:10.20.193.119:6804/527707922 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f7904056c10 con 0x7f78d0060640 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f78eaffd640 10 client.4281.objecter ms_dispatch2 0x7f7904000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f78eaffd640 10 client.4281.objecter _finish_command 2 = system:0 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f78eaffd640 20 client.4281.objecter put_session s=0x7f78d005ff90 osd=5 4 2026-02-13T08:05:49.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.028+0000 7f78eaffd640 15 client.4281.objecter _session_command_op_remove 5 2 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 10 librados: watch_flush enter 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 10 librados: watch_flush exit 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 10 client.4281.objecter close_session for osd.5 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 1 -- 10.20.193.104:0/189502665 >> v1:10.20.193.119:6804/527707922 conn(0x7f78d0060640 legacy=0x7f78d0080a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 20 client.4281.objecter put_session s=0x7f78d005ff90 osd=5 1 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 20 client.4281.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 10 client.4281.objecter successfully canceled tick 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 1 -- 10.20.193.104:0/189502665 >> v1:10.20.193.119:6812/276487904 conn(0x7f78d003ba60 legacy=0x7f78d005bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 10 monclient: shutdown 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 1 -- 10.20.193.104:0/189502665 >> v1:10.20.193.104:6789/0 conn(0x7f790417fc40 legacy=0x7f790416e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7902d76640 1 -- 10.20.193.104:0/189502665 reap_dead start 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 1 -- 10.20.193.104:0/189502665 shutdown_connections 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 1 -- 10.20.193.104:0/189502665 >> 10.20.193.104:0/189502665 conn(0x7f790408c820 msgr2=0x7f790405a930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 1 -- 10.20.193.104:0/189502665 shutdown_connections 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 1 -- 10.20.193.104:0/189502665 wait complete. 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f7908f5d640 1 librados: shutdown 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 10 client.4287.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 15 client.4287.objecter _session_command_op_assign -1 2 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 20 client.4287.objecter _get_session s=0x7f675c05fc50 osd=4 3 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 20 client.4287.objecter put_session s=0x7f675c05fc50 osd=4 3 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 20 client.4287.objecter _get_session s=0x7f675c05fc50 osd=4 3 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 15 client.4287.objecter _session_command_op_remove -1 2 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 20 client.4287.objecter get_session s=0x7f675c05fc50 osd=4 3 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 15 client.4287.objecter _session_command_op_assign 4 2 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 20 client.4287.objecter put_session s=0x7f675c05fc50 osd=4 4 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 10 client.4287.objecter _send_command 2 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 1 -- 10.20.193.104:0/3267155268 --> v1:10.20.193.119:6808/1543069880 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f678c1a2f30 con 0x7f675c060300 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f6779ffb640 1 -- 10.20.193.104:0/3267155268 <== osd.4 v1:10.20.193.119:6808/1543069880 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f678c1a2f30 con 0x7f675c060300 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f6779ffb640 10 client.4287.objecter ms_dispatch2 0x7f678c000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f6779ffb640 10 client.4287.objecter _finish_command 2 = system:0 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f6779ffb640 20 client.4287.objecter put_session s=0x7f675c05fc50 osd=4 4 2026-02-13T08:05:49.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f6779ffb640 15 client.4287.objecter _session_command_op_remove 4 2 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 10 librados: watch_flush enter 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 10 librados: watch_flush exit 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 10 client.4287.objecter close_session for osd.4 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 1 -- 10.20.193.104:0/3267155268 >> v1:10.20.193.119:6808/1543069880 conn(0x7f675c060300 legacy=0x7f675c080730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 20 client.4287.objecter put_session s=0x7f675c05fc50 osd=4 1 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 20 client.4287.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 10 client.4287.objecter successfully canceled tick 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 1 -- 10.20.193.104:0/3267155268 >> v1:10.20.193.119:6812/276487904 conn(0x7f675c03b7e0 legacy=0x7f675c05bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 10 monclient: shutdown 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 1 -- 10.20.193.104:0/3267155268 >> v1:10.20.193.104:6789/0 conn(0x7f678c091740 legacy=0x7f678c12bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f6791cd0640 1 -- 10.20.193.104:0/3267155268 reap_dead start 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 1 -- 10.20.193.104:0/3267155268 shutdown_connections 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 1 -- 10.20.193.104:0/3267155268 >> 10.20.193.104:0/3267155268 conn(0x7f678c090810 msgr2=0x7f678c057f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 1 -- 10.20.193.104:0/3267155268 shutdown_connections 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 1 -- 10.20.193.104:0/3267155268 wait complete. 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.032+0000 7f679375a640 1 librados: shutdown 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 10 client.4280.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-13T08:05:49.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 15 client.4280.objecter _session_command_op_assign -1 2 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 20 client.4280.objecter _get_session s=0x7faa28060180 osd=3 3 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 20 client.4280.objecter put_session s=0x7faa28060180 osd=3 3 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 20 client.4280.objecter _get_session s=0x7faa28060180 osd=3 3 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 15 client.4280.objecter _session_command_op_remove -1 2 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 20 client.4280.objecter get_session s=0x7faa28060180 osd=3 3 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 15 client.4280.objecter _session_command_op_assign 3 2 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 20 client.4280.objecter put_session s=0x7faa28060180 osd=3 4 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 10 client.4280.objecter _send_command 2 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 1 -- 10.20.193.104:0/1009175895 --> v1:10.20.193.119:6800/4283496532 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa58196a60 con 0x7faa28060830 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa54ff9640 1 -- 10.20.193.104:0/1009175895 <== osd.3 v1:10.20.193.119:6800/4283496532 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7faa58196a60 con 0x7faa28060830 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa54ff9640 10 client.4280.objecter ms_dispatch2 0x7faa58000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa54ff9640 10 client.4280.objecter _finish_command 2 = system:0 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa54ff9640 20 client.4280.objecter put_session s=0x7faa28060180 osd=3 4 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa54ff9640 15 client.4280.objecter _session_command_op_remove 3 2 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 10 librados: watch_flush enter 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 10 librados: watch_flush exit 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 10 client.4280.objecter close_session for osd.3 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 1 -- 10.20.193.104:0/1009175895 >> v1:10.20.193.119:6800/4283496532 conn(0x7faa28060830 legacy=0x7faa28080c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 20 client.4280.objecter put_session s=0x7faa28060180 osd=3 1 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 20 client.4280.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 10 client.4280.objecter successfully canceled tick 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 1 -- 10.20.193.104:0/1009175895 >> v1:10.20.193.119:6812/276487904 conn(0x7faa2803bbb0 legacy=0x7faa2805c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 10 monclient: shutdown 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 1 -- 10.20.193.104:0/1009175895 >> v1:10.20.193.104:6790/0 conn(0x7faa5817f7e0 legacy=0x7faa5817eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5cb77640 1 -- 10.20.193.104:0/1009175895 reap_dead start 2026-02-13T08:05:49.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 1 -- 10.20.193.104:0/1009175895 shutdown_connections 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 1 -- 10.20.193.104:0/1009175895 >> 10.20.193.104:0/1009175895 conn(0x7faa5808e1d0 msgr2=0x7faa580897a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 1 -- 10.20.193.104:0/1009175895 shutdown_connections 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 1 -- 10.20.193.104:0/1009175895 wait complete. 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7faa5e601640 1 librados: shutdown 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 10 client.4299.objecter _submit_command 2 [{"prefix": "flush_pg_stats"}] 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 15 client.4299.objecter _session_command_op_assign -1 2 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 20 client.4299.objecter _get_session s=0x7f5c0c05fee0 osd=0 3 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 20 client.4299.objecter put_session s=0x7f5c0c05fee0 osd=0 3 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 20 client.4299.objecter _get_session s=0x7f5c0c05fee0 osd=0 3 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 15 client.4299.objecter _session_command_op_remove -1 2 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 20 client.4299.objecter get_session s=0x7f5c0c05fee0 osd=0 3 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 15 client.4299.objecter _session_command_op_assign 0 2 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 20 client.4299.objecter put_session s=0x7f5c0c05fee0 osd=0 4 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 10 client.4299.objecter _send_command 2 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 1 -- 10.20.193.104:0/1564887464 --> v1:10.20.193.104:6808/1354850314 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5c3c12f450 con 0x7f5c0c060590 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c22ffd640 1 -- 10.20.193.104:0/1564887464 <== osd.0 v1:10.20.193.104:6808/1354850314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f5c3c12f450 con 0x7f5c0c060590 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c22ffd640 10 client.4299.objecter ms_dispatch2 0x7f5c3c000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c22ffd640 10 client.4299.objecter _finish_command 2 = system:0 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c22ffd640 20 client.4299.objecter put_session s=0x7f5c0c05fee0 osd=0 4 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c22ffd640 15 client.4299.objecter _session_command_op_remove 0 2 2026-02-13T08:05:49.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 10 librados: watch_flush enter 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 10 librados: watch_flush exit 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 10 client.4299.objecter close_session for osd.0 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 1 -- 10.20.193.104:0/1564887464 >> v1:10.20.193.104:6808/1354850314 conn(0x7f5c0c060590 legacy=0x7f5c0c0809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 20 client.4299.objecter put_session s=0x7f5c0c05fee0 osd=0 1 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 20 client.4299.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 10 client.4299.objecter successfully canceled tick 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 1 -- 10.20.193.104:0/1564887464 >> v1:10.20.193.119:6812/276487904 conn(0x7f5c0c03ba50 legacy=0x7f5c0c05bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 10 monclient: shutdown 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 1 -- 10.20.193.104:0/1564887464 >> v1:10.20.193.104:6789/0 conn(0x7f5c3c091740 legacy=0x7f5c3c12bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c42af8640 1 -- 10.20.193.104:0/1564887464 reap_dead start 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 1 -- 10.20.193.104:0/1564887464 shutdown_connections 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 1 -- 10.20.193.104:0/1564887464 >> 10.20.193.104:0/1564887464 conn(0x7f5c3c090810 msgr2=0x7f5c3c057f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 1 -- 10.20.193.104:0/1564887464 shutdown_connections 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 1 -- 10.20.193.104:0/1564887464 wait complete. 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.036+0000 7f5c44582640 1 librados: shutdown 2026-02-13T08:05:49.134 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:49.134 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-13T08:05:49.135 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:49.135 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-13T08:05:49.135 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:49.135 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-13T08:05:49.135 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:49.135 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-13T08:05:49.136 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:49.136 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-13T08:05:49.136 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:49.136 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-13T08:05:49.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 10 monclient: monmap: 2026-02-13T08:05:49.241 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.241 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.241 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.238970+0000 2026-02-13T08:05:49.241 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.238970+0000 2026-02-13T08:05:49.241 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.241 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.241 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.241 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 10 monclient: monmap: 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.239019+0000 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.239019+0000 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 1 Processor -- start 2026-02-13T08:05:49.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 1 Processor -- start 2026-02-13T08:05:49.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 1 -- start start 2026-02-13T08:05:49.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 10 monclient: init 2026-02-13T08:05:49.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 1 -- start start 2026-02-13T08:05:49.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 10 monclient: init 2026-02-13T08:05:49.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f76abee9640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f76abee9640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f76abee9640 10 monclient: monmap: 2026-02-13T08:05:49.243 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.243 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.239584+0000 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.239584+0000 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:49.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:49.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 10 monclient(hunting): picked mon.noname-b con 0x7f166c139f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f4e70058970 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 10 monclient(hunting): picked mon.noname-a con 0x7f166c15e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f4e70092c10 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 10 monclient(hunting): picked mon.noname-c con 0x7f166c17fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c13aa00 con 0x7f166c15e200 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c08ba20 con 0x7f166c17fd00 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c089e30 con 0x7f166c139f20 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1673518640 10 monclient(hunting): authenticate will time out at 454.827811s 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1670a8c640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f166c15e200 0x7f166c17e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42088/0 (socket says 10.20.193.104:42088) 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f1670a8c640 1 -- 10.20.193.104:0/583646439 learned_addr learned my addr 10.20.193.104:0/583646439 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f167128d640 1 --1- 10.20.193.104:0/583646439 >> v1:10.20.193.104:6790/0 conn(0x7f166c139f20 0x7f166c13a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40538/0 (socket says 10.20.193.104:40538) 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f4e701818e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7008e450 con 0x7f4e701818e0 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7008e8a0 con 0x7f4e70058970 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7008eb50 con 0x7f4e70092c10 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6ffff640 10 monclient(hunting): authenticate will time out at 454.827818s 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6e7fc640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f4e70092c10 0x7f4e701801c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40552/0 (socket says 10.20.193.104:40552) 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6e7fc640 1 -- 10.20.193.104:0/1240180353 learned_addr learned my addr 10.20.193.104:0/1240180353 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f4e6f7fe640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f4e701818e0 0x7f4e701a1cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42094/0 (socket says 10.20.193.104:42094) 2026-02-13T08:05:49.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.232+0000 7f76abee9640 1 Processor -- start 2026-02-13T08:05:49.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- start start 2026-02-13T08:05:49.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: init 2026-02-13T08:05:49.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086757778 0 0) 0x7f4e7008eb50 con 0x7f4e70092c10 2026-02-13T08:05:49.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674656328 0 0) 0x7f166c089e30 con 0x7f166c139f20 2026-02-13T08:05:49.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): my global_id is 4292 2026-02-13T08:05:49.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): my global_id is 4289 2026-02-13T08:05:49.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e5c003620 con 0x7f4e70092c10 2026-02-13T08:05:49.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1654003620 con 0x7f166c139f20 2026-02-13T08:05:49.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495369156 0 0) 0x7f4e7008e8a0 con 0x7f4e70058970 2026-02-13T08:05:49.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662063252 0 0) 0x7f166c08ba20 con 0x7f166c17fd00 2026-02-13T08:05:49.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): my global_id is 4273 2026-02-13T08:05:49.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): my global_id is 4270 2026-02-13T08:05:49.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e7008eb50 con 0x7f4e70058970 2026-02-13T08:05:49.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f166c089e30 con 0x7f166c17fd00 2026-02-13T08:05:49.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:49.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient(hunting): picked mon.noname-a con 0x7f76a4091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient(hunting): picked mon.noname-b con 0x7f76a413f870 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient(hunting): picked mon.noname-c con 0x7f76a413fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a408e5f0 con 0x7f76a4091740 2026-02-13T08:05:49.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a408e8d0 con 0x7f76a413fcd0 2026-02-13T08:05:49.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a408ebb0 con 0x7f76a413f870 2026-02-13T08:05:49.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient(hunting): authenticate will time out at 454.828396s 2026-02-13T08:05:49.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625510313 0 0) 0x7f1660002920 con 0x7f166c15e200 2026-02-13T08:05:49.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient(hunting): my global_id is 4302 2026-02-13T08:05:49.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f166c08ba20 con 0x7f166c15e200 2026-02-13T08:05:49.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 800956403 0 0) 0x7f4e7008e450 con 0x7f4e701818e0 2026-02-13T08:05:49.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient(hunting): my global_id is 4305 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e7008e8a0 con 0x7f4e701818e0 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3978481493 0 0) 0x7f4e5c003620 con 0x7f4e70092c10 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 >> v1:10.20.193.119:6789/0 conn(0x7f4e70058970 legacy=0x7f4e70059080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 >> v1:10.20.193.104:6789/0 conn(0x7f4e701818e0 legacy=0x7f4e701a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 monclient: found mon.noname-b 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e70059790 con 0x7f4e70092c10 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e58002cb0 con 0x7f4e70092c10 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient: dump: 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.252 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 5 monclient: authenticate success, global_id 4292 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2896340078 0 0) 0x7f166c089e30 con 0x7f166c17fd00 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 >> v1:10.20.193.104:6790/0 conn(0x7f166c139f20 legacy=0x7f166c13a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 >> v1:10.20.193.104:6789/0 conn(0x7f166c15e200 legacy=0x7f166c17e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 monclient: found mon.noname-c 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.119:6789/0 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c08a380 con 0x7f166c17fd00 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a945d640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f76a413f870 0x7f76a4180690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40562/0 (socket says 10.20.193.104:40562) 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a945d640 1 -- 10.20.193.104:0/2095315390 learned_addr learned my addr 10.20.193.104:0/2095315390 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1668003180 con 0x7f166c17fd00 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient: dump: 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.254 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 5 monclient: authenticate success, global_id 4270 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 1 -- 10.20.193.104:0/2095315390 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262775391 0 0) 0x7f76a408e5f0 con 0x7f76a4091740 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient(hunting): my global_id is 4308 2026-02-13T08:05:49.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 1 -- 10.20.193.104:0/2095315390 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f768c003620 con 0x7f76a4091740 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 <== mon.1 v1:10.20.193.119:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1668003350 con 0x7f166c17fd00 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 1 -- 10.20.193.104:0/583646439 <== mon.1 v1:10.20.193.119:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1668003790 con 0x7f166c17fd00 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165bfff640 10 monclient: dump: 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 4 set_mon_vals no callback set 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e58002ef0 con 0x7f4e70092c10 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 1 -- 10.20.193.104:0/1240180353 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e58003330 con 0x7f4e70092c10 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6dffb640 10 monclient: dump: 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 4 set_mon_vals no callback set 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 1 -- 10.20.193.104:0/2095315390 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3452227447 0 0) 0x7f768c003620 con 0x7f76a4091740 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 1 -- 10.20.193.104:0/2095315390 >> v1:10.20.193.104:6790/0 conn(0x7f76a413f870 legacy=0x7f76a4180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 1 -- 10.20.193.104:0/2095315390 >> v1:10.20.193.119:6789/0 conn(0x7f76a413fcd0 legacy=0x7f76a41a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 1 monclient: found mon.noname-a 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 1 -- 10.20.193.104:0/2095315390 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a4091b10 con 0x7f76a4091740 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 1 -- 10.20.193.104:0/2095315390 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7694002e00 con 0x7f76a4091740 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient: dump: 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 5 monclient: authenticate success, global_id 4308 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 1 -- 10.20.193.104:0/2095315390 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7694003010 con 0x7f76a4091740 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 1 -- 10.20.193.104:0/2095315390 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7694003450 con 0x7f76a4091740 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a8c5c640 10 monclient: dump: 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.259 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 4 set_mon_vals no callback set 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient: shutdown 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 -- 10.20.193.104:0/583646439 >> v1:10.20.193.119:6789/0 conn(0x7f166c17fd00 legacy=0x7f166c1a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 -- 10.20.193.104:0/583646439 shutdown_connections 2026-02-13T08:05:49.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 -- 10.20.193.104:0/583646439 >> 10.20.193.104:0/583646439 conn(0x7f166c051a50 msgr2=0x7f166c051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: shutdown 2026-02-13T08:05:49.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- 10.20.193.104:0/1240180353 >> v1:10.20.193.104:6790/0 conn(0x7f4e70092c10 legacy=0x7f4e701801c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 -- 10.20.193.104:0/583646439 shutdown_connections 2026-02-13T08:05:49.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: shutdown 2026-02-13T08:05:49.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 -- 10.20.193.104:0/583646439 wait complete. 2026-02-13T08:05:49.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- 10.20.193.104:0/2095315390 >> v1:10.20.193.104:6789/0 conn(0x7f76a4091740 legacy=0x7f76a413f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- 10.20.193.104:0/1240180353 shutdown_connections 2026-02-13T08:05:49.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- 10.20.193.104:0/1240180353 >> 10.20.193.104:0/1240180353 conn(0x7f4e70051c80 msgr2=0x7f4e70052080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- 10.20.193.104:0/1240180353 shutdown_connections 2026-02-13T08:05:49.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- 10.20.193.104:0/1240180353 wait complete. 2026-02-13T08:05:49.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- 10.20.193.104:0/2095315390 shutdown_connections 2026-02-13T08:05:49.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- 10.20.193.104:0/2095315390 >> 10.20.193.104:0/2095315390 conn(0x7f76a4090810 msgr2=0x7f76a4090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- 10.20.193.104:0/2095315390 shutdown_connections 2026-02-13T08:05:49.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- 10.20.193.104:0/2095315390 wait complete. 2026-02-13T08:05:49.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: monmap: 2026-02-13T08:05:49.262 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient: monmap: 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.263 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 librados: starting msgr at 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 librados: starting objecter 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: monmap: 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.264 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 Processor -- start 2026-02-13T08:05:49.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 librados: starting msgr at 2026-02-13T08:05:49.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 librados: starting objecter 2026-02-13T08:05:49.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- start start 2026-02-13T08:05:49.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 librados: setting wanted keys 2026-02-13T08:05:49.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 librados: calling monclient init 2026-02-13T08:05:49.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: init 2026-02-13T08:05:49.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 librados: starting msgr at 2026-02-13T08:05:49.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 librados: starting objecter 2026-02-13T08:05:49.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 Processor -- start 2026-02-13T08:05:49.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 Processor -- start 2026-02-13T08:05:49.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 -- start start 2026-02-13T08:05:49.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 librados: setting wanted keys 2026-02-13T08:05:49.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 librados: calling monclient init 2026-02-13T08:05:49.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient: init 2026-02-13T08:05:49.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- start start 2026-02-13T08:05:49.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 librados: setting wanted keys 2026-02-13T08:05:49.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 librados: calling monclient init 2026-02-13T08:05:49.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: init 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f4e70058970 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f4e70092c10 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f4e701818e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e70127c80 con 0x7f4e701818e0 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7010eed0 con 0x7f4e70092c10 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7010e060 con 0x7f4e70058970 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient(hunting): authenticate will time out at 454.830146s 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6f7fe640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f4e701818e0 0x7f4e70170050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42110/0 (socket says 10.20.193.104:42110) 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6effd640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f4e70058970 0x7f4e70127570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40576/0 (socket says 10.20.193.104:40576) 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6f7fe640 1 -- 10.20.193.104:0/3596784092 learned_addr learned my addr 10.20.193.104:0/3596784092 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 client.?.objecter ms_handle_connect 0x7f4e70058970 2026-02-13T08:05:49.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 client.?.objecter ms_handle_connect 0x7f4e701818e0 2026-02-13T08:05:49.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:49.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient(hunting): picked mon.noname-b con 0x7f76a4091740 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient(hunting): picked mon.noname-a con 0x7f76a413f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient(hunting): picked mon.noname-c con 0x7f76a413fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a408ab30 con 0x7f76a413f870 2026-02-13T08:05:49.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a412f860 con 0x7f76a4091740 2026-02-13T08:05:49.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a412fb40 con 0x7f76a413fcd0 2026-02-13T08:05:49.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:49.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient(hunting): picked mon.noname-a con 0x7f166c139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient(hunting): authenticate will time out at 454.830378s 2026-02-13T08:05:49.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient(hunting): picked mon.noname-b con 0x7f166c15e200 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient(hunting): picked mon.noname-c con 0x7f166c17fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c162820 con 0x7f166c139f20 2026-02-13T08:05:49.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c165170 con 0x7f166c15e200 2026-02-13T08:05:49.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a945d640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f76a413f870 0x7f76a412c710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42120/0 (socket says 10.20.193.104:42120) 2026-02-13T08:05:49.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76a945d640 1 -- 10.20.193.104:0/106307237 learned_addr learned my addr 10.20.193.104:0/106307237 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f166c17f010 con 0x7f166c17fd00 2026-02-13T08:05:49.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient(hunting): authenticate will time out at 454.830421s 2026-02-13T08:05:49.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 client.?.objecter ms_handle_connect 0x7f4e70092c10 2026-02-13T08:05:49.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 client.?.objecter ms_handle_connect 0x7f76a413f870 2026-02-13T08:05:49.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1671a8e640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f166c17fd00 0x7f166c126aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40594/0 (socket says 10.20.193.104:40594) 2026-02-13T08:05:49.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1671a8e640 1 -- 10.20.193.104:0/3791832542 learned_addr learned my addr 10.20.193.104:0/3791832542 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 client.?.objecter ms_handle_connect 0x7f76a413fcd0 2026-02-13T08:05:49.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 client.?.objecter ms_handle_connect 0x7f166c139f20 2026-02-13T08:05:49.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 client.?.objecter ms_handle_connect 0x7f166c17fd00 2026-02-13T08:05:49.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 client.?.objecter ms_handle_connect 0x7f166c15e200 2026-02-13T08:05:49.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 client.?.objecter ms_handle_connect 0x7f76a4091740 2026-02-13T08:05:49.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041656695 0 0) 0x7f4e70127c80 con 0x7f4e701818e0 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): my global_id is 4311 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3924339293 0 0) 0x7f76a412fb40 con 0x7f76a413fcd0 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e3c003620 con 0x7f4e701818e0 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250231053 0 0) 0x7f4e7010e060 con 0x7f4e70058970 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): my global_id is 4295 2026-02-13T08:05:49.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): my global_id is 4298 2026-02-13T08:05:49.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7674003620 con 0x7f76a413fcd0 2026-02-13T08:05:49.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e70127c80 con 0x7f4e70058970 2026-02-13T08:05:49.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 692413734 0 0) 0x7f166c17f010 con 0x7f166c17fd00 2026-02-13T08:05:49.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2913669064 0 0) 0x7f4e7010eed0 con 0x7f4e70092c10 2026-02-13T08:05:49.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): my global_id is 4276 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): my global_id is 4301 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f163c003620 con 0x7f166c17fd00 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2293969104 0 0) 0x7f166c162820 con 0x7f166c139f20 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069297594 0 0) 0x7f76a408ebb0 con 0x7f76a413f870 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): my global_id is 4314 2026-02-13T08:05:49.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e7010e060 con 0x7f4e70092c10 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): my global_id is 4317 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f166c17f010 con 0x7f166c139f20 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 246022411 0 0) 0x7f166c165170 con 0x7f166c15e200 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): my global_id is 4279 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f166c162820 con 0x7f166c15e200 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a412fb40 con 0x7f76a413f870 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968350842 0 0) 0x7f76a412f860 con 0x7f76a4091740 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): my global_id is 4282 2026-02-13T08:05:49.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76a408ebb0 con 0x7f76a4091740 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1233525235 0 0) 0x7f4e3c003620 con 0x7f4e701818e0 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e7010eed0 con 0x7f4e701818e0 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2890084484 0 0) 0x7f4e70127c80 con 0x7f4e70058970 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e3c003620 con 0x7f4e70058970 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e600033a0 con 0x7f4e701818e0 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 595458054 0 0) 0x7f7674003620 con 0x7f76a413fcd0 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76a412f860 con 0x7f76a413fcd0 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f76a0003050 con 0x7f76a413fcd0 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): dump: 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.276 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.277 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e64003060 con 0x7f4e70058970 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 417635074 0 0) 0x7f4e7010e060 con 0x7f4e70092c10 2026-02-13T08:05:49.278 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e70127c80 con 0x7f4e70092c10 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 164701479 0 0) 0x7f76a412fb40 con 0x7f76a413f870 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7674003620 con 0x7f76a413f870 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7698003020 con 0x7f76a413f870 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f89dd723640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f89dd723640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e58003240 con 0x7f4e70092c10 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.279 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient(hunting): dump: 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f89dd723640 10 monclient: monmap: 2026-02-13T08:05:49.280 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.243209+0000 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.243209+0000 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 69712928 0 0) 0x7f166c17f010 con 0x7f166c139f20 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f166c165170 con 0x7f166c139f20 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3529916524 0 0) 0x7f163c003620 con 0x7f166c17fd00 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f166c17f010 con 0x7f166c17fd00 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f165c0030c0 con 0x7f166c139f20 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2224127539 0 0) 0x7f76a412f860 con 0x7f76a413fcd0 2026-02-13T08:05:49.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 >> v1:10.20.193.119:6789/0 conn(0x7f76a4091740 legacy=0x7f76a412c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3702946406 0 0) 0x7f4e7010eed0 con 0x7f4e701818e0 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 >> v1:10.20.193.104:6790/0 conn(0x7f4e70058970 legacy=0x7f4e70127570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 >> v1:10.20.193.119:6789/0 conn(0x7f4e70092c10 legacy=0x7f4e7016e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3787815409 0 0) 0x7f166c162820 con 0x7f166c15e200 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 >> v1:10.20.193.104:6789/0 conn(0x7f76a413f870 legacy=0x7f76a412c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 monclient: found mon.c 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a412ce20 con 0x7f76a413fcd0 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 monclient: found mon.a 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7010cb70 con 0x7f4e701818e0 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 5 monclient: authenticate success, global_id 4311 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: _renew_subs 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f163c003620 con 0x7f166c15e200 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f16680036a0 con 0x7f166c17fd00 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f16600031f0 con 0x7f166c15e200 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 5 monclient: authenticate success, global_id 4298 2026-02-13T08:05:49.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: _renew_subs 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- 10.20.193.104:0/106307237 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f76a4059160 con 0x7f76a413fcd0 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- 10.20.193.104:0/3596784092 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7010e630 con 0x7f4e701818e0 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 client.4298.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: _renew_subs 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 -- 10.20.193.104:0/106307237 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f76a412e880 con 0x7f76a413fcd0 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 1 librados: init done 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 client.4311.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: _renew_subs 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- 10.20.193.104:0/3596784092 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4e7010d8a0 con 0x7f4e701818e0 2026-02-13T08:05:49.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 librados: init done 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3477620923 0 0) 0x7f166c165170 con 0x7f166c139f20 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 >> v1:10.20.193.104:6790/0 conn(0x7f166c17fd00 legacy=0x7f166c126aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 >> v1:10.20.193.119:6789/0 conn(0x7f166c15e200 legacy=0x7f166c17e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 monclient: found mon.a 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e60004c60 con 0x7f4e701818e0 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e60004fb0 con 0x7f4e701818e0 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f166c05d2c0 con 0x7f166c139f20 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 5 monclient: authenticate success, global_id 4317 2026-02-13T08:05:49.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6d7fa640 4 set_mon_vals no callback set 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 10 monclient: dump: 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient: _renew_subs 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 -- 10.20.193.104:0/3791832542 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f166c086620 con 0x7f166c139f20 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 client.4317.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient: _renew_subs 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 -- 10.20.193.104:0/3791832542 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f166c164e90 con 0x7f166c139f20 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 1 librados: init done 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f165c0048e0 con 0x7f166c139f20 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f165c004c30 con 0x7f166c139f20 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 10 monclient: dump: 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f165b7fe640 4 set_mon_vals no callback set 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76a0003690 con 0x7f76a413fcd0 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f76a0003e60 con 0x7f76a413fcd0 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76927fc640 10 monclient: dump: 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f76abee9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f7693fff640 4 set_mon_vals no callback set 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e6ffff640 1 -- 10.20.193.104:0/3596784092 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e7010c570 con 0x7f4e701818e0 2026-02-13T08:05:49.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f89dd723640 1 Processor -- start 2026-02-13T08:05:49.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1673518640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f4e60010e20 con 0x7f4e701818e0 2026-02-13T08:05:49.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f89dd723640 1 -- start start 2026-02-13T08:05:49.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f89dd723640 10 monclient: init 2026-02-13T08:05:49.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.236+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f165c010c40 con 0x7f166c139f20 2026-02-13T08:05:49.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f1673518640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f1673518640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f76a000fe70 con 0x7f76a413fcd0 2026-02-13T08:05:49.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f4e6004a310 con 0x7f4e701818e0 2026-02-13T08:05:49.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f4e4f7fe640 10 client.4311.objecter ms_dispatch2 0x7f4e70000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f1673518640 1 -- 10.20.193.104:0/3791832542 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f166c163cf0 con 0x7f166c139f20 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f4e4f7fe640 3 client.4311.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f4e4f7fe640 3 client.4311.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f4e4f7fe640 20 client.4311.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f165c04a010 con 0x7f166c139f20 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f1659ffb640 10 client.4317.objecter ms_dispatch2 0x7f166c000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f1659ffb640 3 client.4317.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f1659ffb640 3 client.4317.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f1659ffb640 20 client.4317.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f4e6effd640 10 monclient: get_auth_request con 0x7f4e3c03bc30 auth_method 0 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76abee9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76abee9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76abee9640 1 -- 10.20.193.104:0/106307237 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a412ff20 con 0x7f76a413fcd0 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f76a0049280 con 0x7f76a413fcd0 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76927fc640 10 client.4298.objecter ms_dispatch2 0x7f76a4000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76927fc640 3 client.4298.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76927fc640 3 client.4298.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f1670a8c640 10 monclient: get_auth_request con 0x7f163c03bae0 auth_method 0 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76927fc640 20 client.4298.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76a9c5e640 10 monclient: get_auth_request con 0x7f767403ba40 auth_method 0 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient(hunting): picked mon.noname-a con 0x7f89d813cff0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient(hunting): picked mon.noname-b con 0x7f89d813dad0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f4e4f7fe640 10 client.4311.objecter ms_handle_connect 0x7f4e3c03bc30 2026-02-13T08:05:49.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient(hunting): picked mon.noname-c con 0x7f89d817fcb0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d808edf0 con 0x7f89d813cff0 2026-02-13T08:05:49.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d808e830 con 0x7f89d817fcb0 2026-02-13T08:05:49.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d808eb10 con 0x7f89d813dad0 2026-02-13T08:05:49.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient(hunting): authenticate will time out at 454.832557s 2026-02-13T08:05:49.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f1659ffb640 10 client.4317.objecter ms_handle_connect 0x7f163c03bae0 2026-02-13T08:05:49.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d67fc640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f89d813dad0 0x7f89d817e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40602/0 (socket says 10.20.193.104:40602) 2026-02-13T08:05:49.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d67fc640 1 -- 10.20.193.104:0/3382515504 learned_addr learned my addr 10.20.193.104:0/3382515504 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d6ffd640 1 --1- 10.20.193.104:0/3382515504 >> v1:10.20.193.104:6789/0 conn(0x7f89d813cff0 0x7f89d813d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42132/0 (socket says 10.20.193.104:42132) 2026-02-13T08:05:49.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76927fc640 10 client.4298.objecter ms_handle_connect 0x7f767403ba40 2026-02-13T08:05:49.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 1 -- 10.20.193.104:0/3382515504 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1138766254 0 0) 0x7f89d808e830 con 0x7f89d817fcb0 2026-02-13T08:05:49.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient(hunting): my global_id is 4285 2026-02-13T08:05:49.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 1 -- 10.20.193.104:0/3382515504 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c4003620 con 0x7f89d817fcb0 2026-02-13T08:05:49.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 1 -- 10.20.193.104:0/3382515504 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3064053507 0 0) 0x7f89c4003620 con 0x7f89d817fcb0 2026-02-13T08:05:49.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 1 -- 10.20.193.104:0/3382515504 >> v1:10.20.193.104:6790/0 conn(0x7f89d813dad0 legacy=0x7f89d817e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 1 -- 10.20.193.104:0/3382515504 >> v1:10.20.193.104:6789/0 conn(0x7f89d813cff0 legacy=0x7f89d813d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 1 monclient: found mon.noname-c 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.119:6789/0 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 1 -- 10.20.193.104:0/3382515504 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d808a040 con 0x7f89d817fcb0 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 1 -- 10.20.193.104:0/3382515504 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f89c8003180 con 0x7f89d817fcb0 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient: dump: 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 5 monclient: authenticate success, global_id 4285 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 1 -- 10.20.193.104:0/3382515504 <== mon.1 v1:10.20.193.119:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89c8003400 con 0x7f89d817fcb0 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 1 -- 10.20.193.104:0/3382515504 <== mon.1 v1:10.20.193.119:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f89c8003800 con 0x7f89d817fcb0 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d5ffb640 10 monclient: dump: 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.295 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 4 set_mon_vals no callback set 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: shutdown 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- 10.20.193.104:0/3382515504 >> v1:10.20.193.119:6789/0 conn(0x7f89d817fcb0 legacy=0x7f89d81a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- 10.20.193.104:0/3382515504 shutdown_connections 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- 10.20.193.104:0/3382515504 >> 10.20.193.104:0/3382515504 conn(0x7f89d808d750 msgr2=0x7f89d8085e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- 10.20.193.104:0/3382515504 shutdown_connections 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- 10.20.193.104:0/3382515504 wait complete. 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: monmap: 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 librados: starting msgr at 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 librados: starting objecter 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 Processor -- start 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- start start 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 librados: setting wanted keys 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 librados: calling monclient init 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: init 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f76a412ff20 con 0x7f76a413fcd0 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76927fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f76927fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient(hunting): picked mon.noname-a con 0x7f89d813cff0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient(hunting): picked mon.noname-c con 0x7f89d813dad0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient(hunting): picked mon.noname-b con 0x7f89d817fcb0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d8087840 con 0x7f89d813cff0 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d808c8e0 con 0x7f89d817fcb0 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d80895a0 con 0x7f89d813dad0 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient(hunting): authenticate will time out at 454.834946s 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d6ffd640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f89d813cff0 0x7f89d812cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42142/0 (socket says 10.20.193.104:42142) 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d67fc640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f89d813dad0 0x7f89d817e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40618/0 (socket says 10.20.193.104:40618) 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d6ffd640 1 -- 10.20.193.104:0/3952530772 learned_addr learned my addr 10.20.193.104:0/3952530772 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 client.?.objecter ms_handle_connect 0x7f89d813cff0 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 client.?.objecter ms_handle_connect 0x7f89d813dad0 2026-02-13T08:05:49.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25224679 0 0) 0x7f89d80895a0 con 0x7f89d813dad0 2026-02-13T08:05:49.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): my global_id is 4304 2026-02-13T08:05:49.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a4003620 con 0x7f89d813dad0 2026-02-13T08:05:49.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f4e60016cf0 con 0x7f4e701818e0 2026-02-13T08:05:49.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f4e4f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f4e4f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:49.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 client.?.objecter ms_handle_connect 0x7f89d817fcb0 2026-02-13T08:05:49.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2337904406 0 0) 0x7f89a4003620 con 0x7f89d813dad0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89d80895a0 con 0x7f89d813dad0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f89c0002f60 con 0x7f89d813dad0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): dump: 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4203458378 0 0) 0x7f89d808c8e0 con 0x7f89d817fcb0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient(hunting): my global_id is 4288 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a4003620 con 0x7f89d817fcb0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 878659857 0 0) 0x7f89d80895a0 con 0x7f89d813dad0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 >> v1:10.20.193.119:6789/0 conn(0x7f89d817fcb0 legacy=0x7f89d81174e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 >> v1:10.20.193.104:6789/0 conn(0x7f89d813cff0 legacy=0x7f89d812cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 monclient: found mon.c 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d810e030 con 0x7f89d813dad0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 5 monclient: authenticate success, global_id 4304 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: _renew_subs 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- 10.20.193.104:0/3952530772 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89d810c510 con 0x7f89d813dad0 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 client.4304.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: _renew_subs 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 -- 10.20.193.104:0/3952530772 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f89d812c950 con 0x7f89d813dad0 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89dd723640 1 librados: init done 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89c00048e0 con 0x7f89d813dad0 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f89c0004b50 con 0x7f89d813dad0 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89d57fa640 4 set_mon_vals no callback set 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 10 monclient: dump: 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f89c0004cf0 con 0x7f89d813dad0 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7fbe279b5640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7fbe279b5640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.240+0000 7fbe279b5640 10 monclient: monmap: 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.247986+0000 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.247986+0000 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.300 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89dd723640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89dd723640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89dd723640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89dd723640 1 -- 10.20.193.104:0/3952530772 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d808e070 con 0x7f89d813dad0 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f89c004a240 con 0x7f89d813dad0 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89b77fe640 10 client.4304.objecter ms_dispatch2 0x7f89d8000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89b77fe640 3 client.4304.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89b77fe640 3 client.4304.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 Processor -- start 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89b77fe640 20 client.4304.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- start start 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: init 2026-02-13T08:05:49.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89d6ffd640 10 monclient: get_auth_request con 0x7f89a403b8f0 auth_method 0 2026-02-13T08:05:49.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:49.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient(hunting): picked mon.noname-b con 0x7fbe20091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient(hunting): picked mon.noname-a con 0x7fbe2013f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient(hunting): picked mon.noname-c con 0x7fbe2013fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2008e5f0 con 0x7fbe2013f870 2026-02-13T08:05:49.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89b77fe640 10 client.4304.objecter ms_handle_connect 0x7f89a403b8f0 2026-02-13T08:05:49.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2008e8d0 con 0x7fbe2013fcd0 2026-02-13T08:05:49.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2008ebb0 con 0x7fbe20091740 2026-02-13T08:05:49.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient(hunting): authenticate will time out at 454.836762s 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe2572a640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fbe20091740 0x7fbe2013f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40630/0 (socket says 10.20.193.104:40630) 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe2572a640 1 -- 10.20.193.104:0/404171117 learned_addr learned my addr 10.20.193.104:0/404171117 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 -- 10.20.193.104:0/404171117 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3370827100 0 0) 0x7fbe2008e5f0 con 0x7fbe2013f870 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient(hunting): my global_id is 4320 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 -- 10.20.193.104:0/404171117 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe08003620 con 0x7fbe2013f870 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 -- 10.20.193.104:0/404171117 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3789053454 0 0) 0x7fbe2008e8d0 con 0x7fbe2013fcd0 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient(hunting): my global_id is 4291 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 -- 10.20.193.104:0/404171117 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe2008e5f0 con 0x7fbe2013fcd0 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 -- 10.20.193.104:0/404171117 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2667852213 0 0) 0x7fbe08003620 con 0x7fbe2013f870 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 -- 10.20.193.104:0/404171117 >> v1:10.20.193.104:6790/0 conn(0x7fbe20091740 legacy=0x7fbe2013f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 -- 10.20.193.104:0/404171117 >> v1:10.20.193.119:6789/0 conn(0x7fbe2013fcd0 legacy=0x7fbe201a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 monclient: found mon.noname-a 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 -- 10.20.193.104:0/404171117 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe20091b10 con 0x7fbe2013f870 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 -- 10.20.193.104:0/404171117 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fbe14002d30 con 0x7fbe2013f870 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient: dump: 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.303 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 5 monclient: authenticate success, global_id 4320 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f165c016a50 con 0x7f166c139f20 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f1659ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f1659ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 -- 10.20.193.104:0/404171117 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe14002fc0 con 0x7fbe2013f870 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 1 -- 10.20.193.104:0/404171117 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fbe14003400 con 0x7fbe2013f870 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0ffff640 10 monclient: dump: 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.304 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 4 set_mon_vals no callback set 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: shutdown 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- 10.20.193.104:0/404171117 >> v1:10.20.193.104:6789/0 conn(0x7fbe2013f870 legacy=0x7fbe20180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- 10.20.193.104:0/404171117 shutdown_connections 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- 10.20.193.104:0/404171117 >> 10.20.193.104:0/404171117 conn(0x7fbe20090810 msgr2=0x7fbe20090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- 10.20.193.104:0/404171117 shutdown_connections 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- 10.20.193.104:0/404171117 wait complete. 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: monmap: 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 10 monclient: get_monmap_and_config 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 10 monclient: monmap: 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:49.250331+0000 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:49.250331+0000 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:49.305 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 librados: starting msgr at 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 librados: starting objecter 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 Processor -- start 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- start start 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 librados: setting wanted keys 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 librados: calling monclient init 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: init 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient(hunting): picked mon.noname-c con 0x7fbe20091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient(hunting): picked mon.noname-b con 0x7fbe2013f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient(hunting): picked mon.noname-a con 0x7fbe2013fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2013f4a0 con 0x7fbe2013fcd0 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2012db80 con 0x7fbe2013f870 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2012f640 con 0x7fbe20091740 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient(hunting): authenticate will time out at 454.838746s 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe2572a640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fbe20091740 0x7fbe2014f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40644/0 (socket says 10.20.193.104:40644) 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe2572a640 1 -- 10.20.193.104:0/654305761 learned_addr learned my addr 10.20.193.104:0/654305761 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 client.?.objecter ms_handle_connect 0x7fbe20091740 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 client.?.objecter ms_handle_connect 0x7fbe2013fcd0 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 1 Processor -- start 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3170084287 0 0) 0x7fbe2013f4a0 con 0x7fbe2013fcd0 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient(hunting): my global_id is 4323 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdf0003620 con 0x7fbe2013fcd0 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 1 -- start start 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 10 monclient: init 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 client.?.objecter ms_handle_connect 0x7fbe2013f870 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2914618578 0 0) 0x7fbdf0003620 con 0x7fbe2013fcd0 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe2013f4a0 con 0x7fbe2013fcd0 2026-02-13T08:05:49.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fbe1c003440 con 0x7fbe2013fcd0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient(hunting): dump: 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1672902757 0 0) 0x7fbe2013f4a0 con 0x7fbe2013fcd0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 >> v1:10.20.193.104:6790/0 conn(0x7fbe20091740 legacy=0x7fbe2014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 >> v1:10.20.193.119:6789/0 conn(0x7fbe2013f870 legacy=0x7fbe20190a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 monclient: found mon.a 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2012f920 con 0x7fbe2013fcd0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 5 monclient: authenticate success, global_id 4323 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: _renew_subs 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- 10.20.193.104:0/654305761 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2012e6e0 con 0x7fbe2013fcd0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe1c003a90 con 0x7fbe2013fcd0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 client.4323.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fbe1c003ea0 con 0x7fbe2013fcd0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: _renew_subs 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- 10.20.193.104:0/654305761 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbe2008ad00 con 0x7fbe2013fcd0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0f7fe640 4 set_mon_vals no callback set 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 librados: init done 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 monclient: dump: 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.308 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f89c0016c20 con 0x7f89d813dad0 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89b77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 10 monclient(hunting): picked mon.noname-c con 0x7f0a08091740 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f89b77fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 10 monclient(hunting): picked mon.noname-b con 0x7f0a0813f870 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 10 monclient(hunting): picked mon.noname-a con 0x7f0a0813fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0808e5f0 con 0x7f0a0813fcd0 2026-02-13T08:05:49.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0808e8d0 con 0x7f0a08091740 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0808ebb0 con 0x7f0a0813f870 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 10 monclient(hunting): authenticate will time out at 454.839520s 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0d736640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f0a0813fcd0 0x7f0a081a1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42172/0 (socket says 10.20.193.104:42172) 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0d736640 1 -- 10.20.193.104:0/588416927 learned_addr learned my addr 10.20.193.104:0/588416927 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fbe1c004040 con 0x7fbe2013fcd0 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe279b5640 1 -- 10.20.193.104:0/654305761 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe20061860 con 0x7fbe2013fcd0 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566402364 0 0) 0x7f0a0808e5f0 con 0x7f0a0813fcd0 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): my global_id is 4326 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09f4003620 con 0x7f0a0813fcd0 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96139653 0 0) 0x7f0a0808ebb0 con 0x7f0a0813f870 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): my global_id is 4307 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a0808e5f0 con 0x7f0a0813f870 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389964732 0 0) 0x7f0a0808e8d0 con 0x7f0a08091740 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient(hunting): my global_id is 4297 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a0808ebb0 con 0x7f0a08091740 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7fbe1c049370 con 0x7fbe2013fcd0 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 10 client.4323.objecter ms_dispatch2 0x7fbe20000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 3 client.4323.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 3 client.4323.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2851164254 0 0) 0x7f0a0808e5f0 con 0x7f0a0813f870 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 >> v1:10.20.193.119:6789/0 conn(0x7f0a08091740 legacy=0x7f0a0813f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 >> v1:10.20.193.104:6789/0 conn(0x7f0a0813fcd0 legacy=0x7f0a081a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe0dffb640 20 client.4323.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 monclient: found mon.noname-b 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a08091b10 con 0x7f0a0813f870 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 5 monclient: authenticate success, global_id 4307 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f09f0002d80 con 0x7f0a0813f870 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:49.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f09ff7fe640 10 monclient: dump: 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7f0a0f1c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.244+0000 7fbe2572a640 10 monclient: get_auth_request con 0x7fbdf003b7a0 auth_method 0 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09f0002f50 con 0x7f0a0813f870 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09ff7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09ff7fe640 1 -- 10.20.193.104:0/588416927 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f09f0003390 con 0x7f0a0813f870 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09ff7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09ff7fe640 10 monclient: dump: 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 4 set_mon_vals no callback set 2026-02-13T08:05:49.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7fbe0dffb640 10 client.4323.objecter ms_handle_connect 0x7fbdf003b7a0 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: shutdown 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/588416927 >> v1:10.20.193.104:6790/0 conn(0x7f0a0813f870 legacy=0x7f0a08180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/588416927 shutdown_connections 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/588416927 >> 10.20.193.104:0/588416927 conn(0x7f0a08090810 msgr2=0x7f0a08090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/588416927 shutdown_connections 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/588416927 wait complete. 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: build_initial_monmap 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: monmap: 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 librados: starting msgr at 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 librados: starting objecter 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 Processor -- start 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- start start 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 librados: setting wanted keys 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 librados: calling monclient init 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: init 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient(hunting): picked mon.noname-b con 0x7f0a08091740 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient(hunting): picked mon.noname-a con 0x7f0a0813f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient(hunting): picked mon.noname-c con 0x7f0a0813fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0812fcd0 con 0x7f0a0813f870 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0812cd70 con 0x7f0a08091740 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a08130180 con 0x7f0a0813fcd0 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient(hunting): authenticate will time out at 454.841339s 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fffff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f0a0813f870 0x7f0a0812c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42188/0 (socket says 10.20.193.104:42188) 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fffff640 1 -- 10.20.193.104:0/3971648405 learned_addr learned my addr 10.20.193.104:0/3971648405 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 client.?.objecter ms_handle_connect 0x7f0a0813f870 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 client.?.objecter ms_handle_connect 0x7f0a0813fcd0 2026-02-13T08:05:49.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790745288 0 0) 0x7f0a08130180 con 0x7f0a0813fcd0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): my global_id is 4310 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09d8003620 con 0x7f0a0813fcd0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 client.?.objecter ms_handle_connect 0x7f0a08091740 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2954469408 0 0) 0x7f0a0812cd70 con 0x7f0a08091740 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): my global_id is 4300 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a08130180 con 0x7f0a08091740 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1393556312 0 0) 0x7f09d8003620 con 0x7f0a0813fcd0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a0812cd70 con 0x7f0a0813fcd0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0a040033c0 con 0x7f0a0813fcd0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): dump: 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1499965772 0 0) 0x7f0a0812cd70 con 0x7f0a0813fcd0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 >> v1:10.20.193.119:6789/0 conn(0x7f0a08091740 legacy=0x7f0a0812bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 >> v1:10.20.193.104:6789/0 conn(0x7f0a0813f870 legacy=0x7f0a0812c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient: _finish_hunting 0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 monclient: found mon.c 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a08059180 con 0x7f0a0813fcd0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient: _finish_auth 0 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient: _check_auth_tickets 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 5 monclient: authenticate success, global_id 4310 2026-02-13T08:05:49.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: _renew_subs 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/3971648405 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0a0808ab30 con 0x7f0a0813fcd0 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 client.4310.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: _renew_subs 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/3971648405 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0a0812f9f0 con 0x7f0a0813fcd0 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 librados: init done 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a04004c60 con 0x7f0a0813fcd0 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0a04005070 con 0x7f0a0813fcd0 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09feffd640 4 set_mon_vals no callback set 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 monclient: dump: 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7fbe1c015d50 con 0x7fbe2013fcd0 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7fbe0dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7fbe0dffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/3971648405 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a08061860 con 0x7f0a0813fcd0 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f0a04005290 con 0x7f0a0813fcd0 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f0a0404a560 con 0x7f0a0813fcd0 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 client.4310.objecter ms_dispatch2 0x7f0a08000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 3 client.4310.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 3 client.4310.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 20 client.4310.objecter dump_active .. 0 homeless 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f0a0cf35640 10 monclient: get_auth_request con 0x7f09d803b7f0 auth_method 0 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.248+0000 7f09fd7fa640 10 client.4310.objecter ms_handle_connect 0x7f09d803b7f0 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.252+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f0a04017000 con 0x7f0a0813fcd0 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.252+0000 7f09fd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:49.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.252+0000 7f09fd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:49.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T08:05:49.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T08:05:49.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 1 -- 10.20.193.104:0/106307237 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f76a412dac0 con 0x7f76a413fcd0 2026-02-13T08:05:49.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76927fc640 1 -- 10.20.193.104:0/106307237 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 555833778) 0x7f76a0015cc0 con 0x7f76a413fcd0 2026-02-13T08:05:49.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76927fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T08:05:49.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76927fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:49.337 INFO:teuthology.orchestra.run.trial104.stdout:47244640258 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 10 librados: watch_flush enter 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 10 librados: watch_flush exit 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 20 client.4298.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 10 client.4298.objecter successfully canceled tick 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 1 -- 10.20.193.104:0/106307237 >> v1:10.20.193.119:6812/276487904 conn(0x7f767403ba40 legacy=0x7f767405bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 10 monclient: shutdown 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 1 -- 10.20.193.104:0/106307237 >> v1:10.20.193.104:6790/0 conn(0x7f76a413fcd0 legacy=0x7f76a41919d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 1 -- 10.20.193.104:0/106307237 shutdown_connections 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 1 -- 10.20.193.104:0/106307237 >> 10.20.193.104:0/106307237 conn(0x7f76a4090810 msgr2=0x7f76a408beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 1 -- 10.20.193.104:0/106307237 shutdown_connections 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 1 -- 10.20.193.104:0/106307237 wait complete. 2026-02-13T08:05:49.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.328+0000 7f76abee9640 1 librados: shutdown 2026-02-13T08:05:49.339 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T08:05:49.339 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T08:05:49.339 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.339 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 1 -- 10.20.193.104:0/3952530772 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f89d8060360 con 0x7f89d813dad0 2026-02-13T08:05:49.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89b77fe640 1 -- 10.20.193.104:0/3952530772 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 555833778) 0x7f89c0016520 con 0x7f89d813dad0 2026-02-13T08:05:49.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89b77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T08:05:49.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89b77fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:49.340 INFO:teuthology.orchestra.run.trial104.stdout:47244640258 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 10 librados: watch_flush enter 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 10 librados: watch_flush exit 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 20 client.4304.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 10 client.4304.objecter successfully canceled tick 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 1 -- 10.20.193.104:0/3952530772 >> v1:10.20.193.119:6812/276487904 conn(0x7f89a403b8f0 legacy=0x7f89a405bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 10 monclient: shutdown 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 1 -- 10.20.193.104:0/3952530772 >> v1:10.20.193.104:6790/0 conn(0x7f89d813dad0 legacy=0x7f89d817e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 1 -- 10.20.193.104:0/3952530772 shutdown_connections 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 1 -- 10.20.193.104:0/3952530772 >> 10.20.193.104:0/3952530772 conn(0x7f89d808d750 msgr2=0x7f89d805cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 1 -- 10.20.193.104:0/3952530772 shutdown_connections 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 1 -- 10.20.193.104:0/3952530772 wait complete. 2026-02-13T08:05:49.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.332+0000 7f89dd723640 1 librados: shutdown 2026-02-13T08:05:49.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T08:05:49.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T08:05:49.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 1 -- 10.20.193.104:0/654305761 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbe201500d0 con 0x7fbe2013fcd0 2026-02-13T08:05:49.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe0dffb640 1 -- 10.20.193.104:0/654305761 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 555833778) 0x7fbe1c015650 con 0x7fbe2013fcd0 2026-02-13T08:05:49.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe0dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T08:05:49.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe0dffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:49.343 INFO:teuthology.orchestra.run.trial104.stdout:47244640258 2026-02-13T08:05:49.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 10 librados: watch_flush enter 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 10 librados: watch_flush exit 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 20 client.4323.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 10 client.4323.objecter successfully canceled tick 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 1 -- 10.20.193.104:0/654305761 >> v1:10.20.193.119:6812/276487904 conn(0x7fbdf003b7a0 legacy=0x7fbdf005bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 10 monclient: shutdown 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 1 -- 10.20.193.104:0/654305761 >> v1:10.20.193.104:6789/0 conn(0x7fbe2013fcd0 legacy=0x7fbe20192170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 1 -- 10.20.193.104:0/654305761 shutdown_connections 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 1 -- 10.20.193.104:0/654305761 >> 10.20.193.104:0/654305761 conn(0x7fbe20090810 msgr2=0x7fbe2008bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 1 -- 10.20.193.104:0/654305761 shutdown_connections 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 1 -- 10.20.193.104:0/654305761 wait complete. 2026-02-13T08:05:49.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.336+0000 7fbe279b5640 1 librados: shutdown 2026-02-13T08:05:49.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T08:05:49.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T08:05:49.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:49.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/3971648405 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0a0812e530 con 0x7f0a0813fcd0 2026-02-13T08:05:49.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f09fd7fa640 1 -- 10.20.193.104:0/3971648405 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 555833778) 0x7f0a04016900 con 0x7f0a0813fcd0 2026-02-13T08:05:49.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f09fd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T08:05:49.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f09fd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:49.348 INFO:teuthology.orchestra.run.trial104.stdout:47244640258 2026-02-13T08:05:49.349 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2026-02-13T08:05:49.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 10 librados: watch_flush enter 2026-02-13T08:05:49.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 10 librados: watch_flush exit 2026-02-13T08:05:49.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 20 client.4310.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 10 client.4310.objecter successfully canceled tick 2026-02-13T08:05:49.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/3971648405 >> v1:10.20.193.119:6812/276487904 conn(0x7f09d803b7f0 legacy=0x7f09d805bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 10 monclient: shutdown 2026-02-13T08:05:49.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/3971648405 >> v1:10.20.193.104:6790/0 conn(0x7f0a0813fcd0 legacy=0x7f0a081919d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/3971648405 shutdown_connections 2026-02-13T08:05:49.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/3971648405 >> 10.20.193.104:0/3971648405 conn(0x7f0a08090810 msgr2=0x7f0a0808c620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/3971648405 shutdown_connections 2026-02-13T08:05:49.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 1 -- 10.20.193.104:0/3971648405 wait complete. 2026-02-13T08:05:49.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.340+0000 7f0a0f1c0640 1 librados: shutdown 2026-02-13T08:05:49.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T08:05:49.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T08:05:49.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 1 -- 10.20.193.104:0/3596784092 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4e701a35f0 con 0x7f4e701818e0 2026-02-13T08:05:49.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e4f7fe640 1 -- 10.20.193.104:0/3596784092 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 555833778) 0x7f4e600165f0 con 0x7f4e701818e0 2026-02-13T08:05:49.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e4f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T08:05:49.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e4f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:49.351 INFO:teuthology.orchestra.run.trial104.stdout:47244640258 2026-02-13T08:05:49.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T08:05:49.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T08:05:49.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:49.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 1 -- 10.20.193.104:0/3791832542 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f166c0380f0 con 0x7f166c139f20 2026-02-13T08:05:49.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1659ffb640 1 -- 10.20.193.104:0/3791832542 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 555833778) 0x7f165c016350 con 0x7f166c139f20 2026-02-13T08:05:49.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1659ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T08:05:49.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1659ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:49.352 INFO:teuthology.orchestra.run.trial104.stdout:47244640258 2026-02-13T08:05:49.352 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.2 2026-02-13T08:05:49.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 10 librados: watch_flush enter 2026-02-13T08:05:49.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 10 librados: watch_flush exit 2026-02-13T08:05:49.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 20 client.4311.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 10 client.4311.objecter successfully canceled tick 2026-02-13T08:05:49.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 1 -- 10.20.193.104:0/3596784092 >> v1:10.20.193.119:6812/276487904 conn(0x7f4e3c03bc30 legacy=0x7f4e3c05c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 10 monclient: shutdown 2026-02-13T08:05:49.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 1 -- 10.20.193.104:0/3596784092 >> v1:10.20.193.104:6789/0 conn(0x7f4e701818e0 legacy=0x7f4e70170050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 1 -- 10.20.193.104:0/3596784092 shutdown_connections 2026-02-13T08:05:49.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 1 -- 10.20.193.104:0/3596784092 >> 10.20.193.104:0/3596784092 conn(0x7f4e70051c80 msgr2=0x7f4e7008aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 1 -- 10.20.193.104:0/3596784092 shutdown_connections 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 1 -- 10.20.193.104:0/3596784092 wait complete. 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f4e6ffff640 1 librados: shutdown 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 10 librados: watch_flush enter 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 10 librados: watch_flush exit 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 20 client.4317.objecter shutdown clearing up homeless session... 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 10 client.4317.objecter successfully canceled tick 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 1 -- 10.20.193.104:0/3791832542 >> v1:10.20.193.119:6812/276487904 conn(0x7f163c03bae0 legacy=0x7f163c05bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 10 monclient: shutdown 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 1 -- 10.20.193.104:0/3791832542 >> v1:10.20.193.104:6789/0 conn(0x7f166c139f20 legacy=0x7f166c17e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:49.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 1 -- 10.20.193.104:0/3791832542 shutdown_connections 2026-02-13T08:05:49.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 1 -- 10.20.193.104:0/3791832542 >> 10.20.193.104:0/3791832542 conn(0x7f166c051a50 msgr2=0x7f166c05bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:49.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 1 -- 10.20.193.104:0/3791832542 shutdown_connections 2026-02-13T08:05:49.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 1 -- 10.20.193.104:0/3791832542 wait complete. 2026-02-13T08:05:49.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:49.344+0000 7f1673518640 1 librados: shutdown 2026-02-13T08:05:49.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.3 2026-02-13T08:05:49.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2026-02-13T08:05:49.363 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.1 2026-02-13T08:05:49.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2026-02-13T08:05:50.349 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-13T08:05:50.353 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-13T08:05:50.356 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-13T08:05:50.361 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-13T08:05:50.364 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-13T08:05:50.365 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-13T08:05:50.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 10 monclient: get_monmap_and_config 2026-02-13T08:05:50.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 10 monclient: monmap: 2026-02-13T08:05:50.413 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.414 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.414 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:50.410662+0000 2026-02-13T08:05:50.414 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:50.410662+0000 2026-02-13T08:05:50.414 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.414 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.414 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.414 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:50.414 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:50.414 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 1 Processor -- start 2026-02-13T08:05:50.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 1 -- start start 2026-02-13T08:05:50.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 10 monclient: init 2026-02-13T08:05:50.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:50.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 10 monclient(hunting): picked mon.noname-b con 0x7f15d4091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 10 monclient(hunting): picked mon.noname-a con 0x7f15d413f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 10 monclient(hunting): picked mon.noname-c con 0x7f15d413fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d408e5f0 con 0x7f15d413f870 2026-02-13T08:05:50.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d408e8d0 con 0x7f15d413fcd0 2026-02-13T08:05:50.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d408ebb0 con 0x7f15d4091740 2026-02-13T08:05:50.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15da5e9640 10 monclient(hunting): authenticate will time out at 455.999651s 2026-02-13T08:05:50.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d37fe640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f15d413f870 0x7f15d4180690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42196/0 (socket says 10.20.193.104:42196) 2026-02-13T08:05:50.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d3fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f15d4091740 0x7f15d413f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40672/0 (socket says 10.20.193.104:40672) 2026-02-13T08:05:50.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d37fe640 1 -- 10.20.193.104:0/3661443393 learned_addr learned my addr 10.20.193.104:0/3661443393 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 1 -- 10.20.193.104:0/3661443393 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1582346835 0 0) 0x7f15d408e5f0 con 0x7f15d413f870 2026-02-13T08:05:50.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 10 monclient(hunting): my global_id is 4329 2026-02-13T08:05:50.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 1 -- 10.20.193.104:0/3661443393 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15b8003620 con 0x7f15d413f870 2026-02-13T08:05:50.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 1 -- 10.20.193.104:0/3661443393 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2407326522 0 0) 0x7f15d408ebb0 con 0x7f15d4091740 2026-02-13T08:05:50.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 10 monclient(hunting): my global_id is 4313 2026-02-13T08:05:50.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.404+0000 7f15d2ffd640 1 -- 10.20.193.104:0/3661443393 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15d408e5f0 con 0x7f15d4091740 2026-02-13T08:05:50.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 1 -- 10.20.193.104:0/3661443393 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4244578377 0 0) 0x7f15d408e5f0 con 0x7f15d4091740 2026-02-13T08:05:50.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 1 -- 10.20.193.104:0/3661443393 >> v1:10.20.193.119:6789/0 conn(0x7f15d413fcd0 legacy=0x7f15d41a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 1 -- 10.20.193.104:0/3661443393 >> v1:10.20.193.104:6789/0 conn(0x7f15d413f870 legacy=0x7f15d4180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 1 monclient: found mon.noname-b 2026-02-13T08:05:50.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 1 -- 10.20.193.104:0/3661443393 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d4091b10 con 0x7f15d4091740 2026-02-13T08:05:50.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 1 -- 10.20.193.104:0/3661443393 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f15c0002e00 con 0x7f15d4091740 2026-02-13T08:05:50.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 5 monclient: authenticate success, global_id 4313 2026-02-13T08:05:50.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:50.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:50.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 10 monclient: dump: 2026-02-13T08:05:50.428 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.429 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.429 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.429 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.429 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.429 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.429 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.429 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.429 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.429 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:50.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 1 -- 10.20.193.104:0/3661443393 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15c0002fd0 con 0x7f15d4091740 2026-02-13T08:05:50.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 1 -- 10.20.193.104:0/3661443393 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f15c0003390 con 0x7f15d4091740 2026-02-13T08:05:50.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:50.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 4 set_mon_vals no callback set 2026-02-13T08:05:50.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:50.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d2ffd640 10 monclient: dump: 2026-02-13T08:05:50.430 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.431 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.431 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.431 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.431 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.431 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.431 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.431 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.431 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.431 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.431 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: shutdown 2026-02-13T08:05:50.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- 10.20.193.104:0/3661443393 >> v1:10.20.193.104:6790/0 conn(0x7f15d4091740 legacy=0x7f15d413f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- 10.20.193.104:0/3661443393 shutdown_connections 2026-02-13T08:05:50.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- 10.20.193.104:0/3661443393 >> 10.20.193.104:0/3661443393 conn(0x7f15d4090810 msgr2=0x7f15d4090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- 10.20.193.104:0/3661443393 shutdown_connections 2026-02-13T08:05:50.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- 10.20.193.104:0/3661443393 wait complete. 2026-02-13T08:05:50.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: monmap: 2026-02-13T08:05:50.432 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.432 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:50.433 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:50.433 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:50.433 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.433 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.433 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.433 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:50.433 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:50.433 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 librados: starting msgr at 2026-02-13T08:05:50.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 librados: starting objecter 2026-02-13T08:05:50.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 Processor -- start 2026-02-13T08:05:50.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- start start 2026-02-13T08:05:50.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 librados: setting wanted keys 2026-02-13T08:05:50.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 librados: calling monclient init 2026-02-13T08:05:50.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: init 2026-02-13T08:05:50.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:50.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient(hunting): picked mon.noname-a con 0x7f15d4091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient(hunting): picked mon.noname-b con 0x7f15d413f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient(hunting): picked mon.noname-c con 0x7f15d413fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d412fb60 con 0x7f15d4091740 2026-02-13T08:05:50.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d412cb60 con 0x7f15d413f870 2026-02-13T08:05:50.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15d4059150 con 0x7f15d413fcd0 2026-02-13T08:05:50.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient(hunting): authenticate will time out at 456.001414s 2026-02-13T08:05:50.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d3fff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f15d4091740 0x7f15d412bd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42200/0 (socket says 10.20.193.104:42200) 2026-02-13T08:05:50.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d3fff640 1 -- 10.20.193.104:0/810467657 learned_addr learned my addr 10.20.193.104:0/810467657 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 client.?.objecter ms_handle_connect 0x7f15d4091740 2026-02-13T08:05:50.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 client.?.objecter ms_handle_connect 0x7f15d413fcd0 2026-02-13T08:05:50.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699522937 0 0) 0x7f15d412fb60 con 0x7f15d4091740 2026-02-13T08:05:50.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): my global_id is 4332 2026-02-13T08:05:50.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15a4003620 con 0x7f15d4091740 2026-02-13T08:05:50.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876148141 0 0) 0x7f15d4059150 con 0x7f15d413fcd0 2026-02-13T08:05:50.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): my global_id is 4316 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15d412fb60 con 0x7f15d413fcd0 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 client.?.objecter ms_handle_connect 0x7f15d413f870 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1900171839 0 0) 0x7f15a4003620 con 0x7f15d4091740 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15d4059150 con 0x7f15d4091740 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f15c0002d10 con 0x7f15d4091740 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): dump: 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.437 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.438 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.438 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.438 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.438 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.438 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.438 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.438 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:50.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1111249622 0 0) 0x7f15d412fb60 con 0x7f15d413fcd0 2026-02-13T08:05:50.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15a4003620 con 0x7f15d413fcd0 2026-02-13T08:05:50.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f15c80033a0 con 0x7f15d413fcd0 2026-02-13T08:05:50.439 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.439 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:50.439 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient(hunting): dump: 2026-02-13T08:05:50.439 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.439 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.439 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.439 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.439 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.439 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.439 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.439 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.440 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.440 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1900149327 0 0) 0x7f15d4059150 con 0x7f15d4091740 2026-02-13T08:05:50.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 >> v1:10.20.193.104:6790/0 conn(0x7f15d413fcd0 legacy=0x7f15d41917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 >> v1:10.20.193.119:6789/0 conn(0x7f15d413f870 legacy=0x7f15d412c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 monclient: found mon.a 2026-02-13T08:05:50.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d408ab30 con 0x7f15d4091740 2026-02-13T08:05:50.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 5 monclient: authenticate success, global_id 4332 2026-02-13T08:05:50.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: _renew_subs 2026-02-13T08:05:50.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- 10.20.193.104:0/810467657 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f15d412d800 con 0x7f15d4091740 2026-02-13T08:05:50.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 client.4332.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:50.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: _renew_subs 2026-02-13T08:05:50.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- 10.20.193.104:0/810467657 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f15d413f4a0 con 0x7f15d4091740 2026-02-13T08:05:50.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 librados: init done 2026-02-13T08:05:50.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15c0002eb0 con 0x7f15d4091740 2026-02-13T08:05:50.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f15c0004d30 con 0x7f15d4091740 2026-02-13T08:05:50.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:50.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 monclient: dump: 2026-02-13T08:05:50.442 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.442 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.442 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.443 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.443 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.443 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.443 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.443 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.443 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d27fc640 4 set_mon_vals no callback set 2026-02-13T08:05:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f15c0004ed0 con 0x7f15d4091740 2026-02-13T08:05:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15da5e9640 1 -- 10.20.193.104:0/810467657 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d4061860 con 0x7f15d4091740 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f15c004a240 con 0x7f15d4091740 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 client.4332.objecter ms_dispatch2 0x7f15d4000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 3 client.4332.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 3 client.4332.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 20 client.4332.objecter dump_active .. 0 homeless 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d37fe640 10 monclient: get_auth_request con 0x7f15a403b8a0 auth_method 0 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.408+0000 7f15d0ff9640 10 client.4332.objecter ms_handle_connect 0x7f15a403b8a0 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.412+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f15c0016ce0 con 0x7f15d4091740 2026-02-13T08:05:50.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.412+0000 7f15d0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.412+0000 7f15d0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:50.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient: get_monmap_and_config 2026-02-13T08:05:50.454 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.454 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient: monmap: 2026-02-13T08:05:50.454 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.454 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.454 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:50.449853+0000 2026-02-13T08:05:50.454 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:50.449853+0000 2026-02-13T08:05:50.454 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 1 Processor -- start 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 1 -- start start 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient: init 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient(hunting): picked mon.noname-c con 0x7f1250090840 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient(hunting): picked mon.noname-a con 0x7f125008c7e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.455 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient(hunting): picked mon.noname-b con 0x7f125008cbe0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.456 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1250090d40 con 0x7f125008c7e0 2026-02-13T08:05:50.456 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f125008db10 con 0x7f1250090840 2026-02-13T08:05:50.456 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f125005e080 con 0x7f125008cbe0 2026-02-13T08:05:50.456 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.456 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient(hunting): authenticate will time out at 456.038537s 2026-02-13T08:05:50.456 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1256446640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f125008cbe0 0x7f12501a1ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40694/0 (socket says 10.20.193.104:40694) 2026-02-13T08:05:50.456 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1255444640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f125008c7e0 0x7f12501805b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42214/0 (socket says 10.20.193.104:42214) 2026-02-13T08:05:50.456 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1256446640 1 -- 10.20.193.104:0/1893306362 learned_addr learned my addr 10.20.193.104:0/1893306362 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.457 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 10 monclient: get_monmap_and_config 2026-02-13T08:05:50.457 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.457 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 10 monclient: monmap: 2026-02-13T08:05:50.457 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.457 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.457 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:50.450712+0000 2026-02-13T08:05:50.457 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:50.450712+0000 2026-02-13T08:05:50.457 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.458 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.458 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.458 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:50.458 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:50.458 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.459 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 -- 10.20.193.104:0/1893306362 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3343586132 0 0) 0x7f125005e080 con 0x7f125008cbe0 2026-02-13T08:05:50.459 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient(hunting): my global_id is 4319 2026-02-13T08:05:50.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 -- 10.20.193.104:0/1893306362 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1238003620 con 0x7f125008cbe0 2026-02-13T08:05:50.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 -- 10.20.193.104:0/1893306362 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 509771353 0 0) 0x7f1250090d40 con 0x7f125008c7e0 2026-02-13T08:05:50.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient(hunting): my global_id is 4335 2026-02-13T08:05:50.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 -- 10.20.193.104:0/1893306362 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f125005e080 con 0x7f125008c7e0 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 -- 10.20.193.104:0/1893306362 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1219828344 0 0) 0x7f125005e080 con 0x7f125008c7e0 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 -- 10.20.193.104:0/1893306362 >> v1:10.20.193.104:6790/0 conn(0x7f125008cbe0 legacy=0x7f12501a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 -- 10.20.193.104:0/1893306362 >> v1:10.20.193.119:6789/0 conn(0x7f1250090840 legacy=0x7f125008c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 monclient: found mon.noname-a 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 -- 10.20.193.104:0/1893306362 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12501a6430 con 0x7f125008c7e0 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 -- 10.20.193.104:0/1893306362 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1244002e00 con 0x7f125008c7e0 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient: dump: 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.462 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.463 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 5 monclient: authenticate success, global_id 4335 2026-02-13T08:05:50.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:50.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 -- 10.20.193.104:0/1893306362 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1244003050 con 0x7f125008c7e0 2026-02-13T08:05:50.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 1 -- 10.20.193.104:0/1893306362 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1244003490 con 0x7f125008c7e0 2026-02-13T08:05:50.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:50.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 1 Processor -- start 2026-02-13T08:05:50.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1254c43640 10 monclient: dump: 2026-02-13T08:05:50.464 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.464 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.464 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.464 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.464 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.464 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.465 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.465 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.465 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.465 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:50.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 4 set_mon_vals no callback set 2026-02-13T08:05:50.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7efdf5039640 10 monclient: get_monmap_and_config 2026-02-13T08:05:50.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7efdf5039640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7efdf5039640 10 monclient: monmap: 2026-02-13T08:05:50.466 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.466 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.466 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:50.451220+0000 2026-02-13T08:05:50.466 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:50.451220+0000 2026-02-13T08:05:50.466 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.466 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.466 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.466 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:50.466 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:50.466 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 1 -- start start 2026-02-13T08:05:50.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 10 monclient: init 2026-02-13T08:05:50.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient: shutdown 2026-02-13T08:05:50.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 1 -- 10.20.193.104:0/1893306362 >> v1:10.20.193.104:6789/0 conn(0x7f125008c7e0 legacy=0x7f12501805b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 1 -- 10.20.193.104:0/1893306362 shutdown_connections 2026-02-13T08:05:50.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 1 -- 10.20.193.104:0/1893306362 >> 10.20.193.104:0/1893306362 conn(0x7f125008e1d0 msgr2=0x7f125008e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 1 -- 10.20.193.104:0/1893306362 shutdown_connections 2026-02-13T08:05:50.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:50.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 10 monclient(hunting): picked mon.noname-b con 0x7f0c1808fc20 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 10 monclient(hunting): picked mon.noname-a con 0x7f0c1813f820 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 10 monclient(hunting): picked mon.noname-c con 0x7f0c1813fca0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 1 -- 10.20.193.104:0/1893306362 wait complete. 2026-02-13T08:05:50.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1808ecd0 con 0x7f0c1813f820 2026-02-13T08:05:50.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1808e710 con 0x7f0c1813fca0 2026-02-13T08:05:50.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1808e9f0 con 0x7f0c1808fc20 2026-02-13T08:05:50.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 10 monclient(hunting): authenticate will time out at 456.039576s 2026-02-13T08:05:50.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7efdf5039640 1 Processor -- start 2026-02-13T08:05:50.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7efdf5039640 1 -- start start 2026-02-13T08:05:50.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7efdf5039640 10 monclient: init 2026-02-13T08:05:50.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1d6d9640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f0c1808fc20 0x7f0c1813f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40702/0 (socket says 10.20.193.104:40702) 2026-02-13T08:05:50.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1ced8640 1 --1- 10.20.193.104:0/3862536837 >> v1:10.20.193.104:6789/0 conn(0x7f0c1813f820 0x7f0c181806b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42230/0 (socket says 10.20.193.104:42230) 2026-02-13T08:05:50.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1d6d9640 1 -- 10.20.193.104:0/3862536837 learned_addr learned my addr 10.20.193.104:0/3862536837 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 1 -- 10.20.193.104:0/3862536837 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2802139565 0 0) 0x7f0c1808ecd0 con 0x7f0c1813f820 2026-02-13T08:05:50.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient(hunting): my global_id is 4338 2026-02-13T08:05:50.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 1 -- 10.20.193.104:0/3862536837 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c00003620 con 0x7f0c1813f820 2026-02-13T08:05:50.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 1 -- 10.20.193.104:0/3862536837 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 873240354 0 0) 0x7f0c1808e9f0 con 0x7f0c1808fc20 2026-02-13T08:05:50.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient(hunting): my global_id is 4322 2026-02-13T08:05:50.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 1 -- 10.20.193.104:0/3862536837 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c1808ecd0 con 0x7f0c1808fc20 2026-02-13T08:05:50.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f1257ed0640 10 monclient: monmap: 2026-02-13T08:05:50.473 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.474 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:50.474 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:50.474 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:50.474 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.474 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.474 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.474 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:50.474 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:50.474 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 1 -- 10.20.193.104:0/3862536837 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3812300335 0 0) 0x7f0c00003620 con 0x7f0c1813f820 2026-02-13T08:05:50.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 1 -- 10.20.193.104:0/3862536837 >> v1:10.20.193.104:6790/0 conn(0x7f0c1808fc20 legacy=0x7f0c1813f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 1 -- 10.20.193.104:0/3862536837 >> v1:10.20.193.119:6789/0 conn(0x7f0c1813fca0 legacy=0x7f0c181a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:05:50.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 1 monclient: found mon.noname-a 2026-02-13T08:05:50.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 1 -- 10.20.193.104:0/3862536837 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c180521f0 con 0x7f0c1813f820 2026-02-13T08:05:50.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7efdf5039640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 1 -- 10.20.193.104:0/3862536837 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0c0c002e00 con 0x7f0c1813f820 2026-02-13T08:05:50.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:50.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c07fff640 10 monclient: dump: 2026-02-13T08:05:50.476 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.476 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.477 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.477 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.477 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.477 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.477 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.477 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.477 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.477 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 5 monclient: authenticate success, global_id 4338 2026-02-13T08:05:50.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7efdf5039640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:50.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7f0c1f964640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:50.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7efdf5039640 10 monclient(hunting): picked mon.noname-c con 0x7efdf0091740 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.444+0000 7efdf5039640 10 monclient(hunting): picked mon.noname-a con 0x7efdf013f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient(hunting): picked mon.noname-b con 0x7efdf013fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf008e5f0 con 0x7efdf013f870 2026-02-13T08:05:50.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 librados: starting msgr at 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 librados: starting objecter 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c07fff640 1 -- 10.20.193.104:0/3862536837 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c0c003040 con 0x7f0c1813f820 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c07fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c07fff640 1 -- 10.20.193.104:0/3862536837 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0c0c003480 con 0x7f0c1813f820 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c07fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c07fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c07fff640 10 monclient: dump: 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.479 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.480 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.480 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.480 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.480 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:50.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 4 set_mon_vals no callback set 2026-02-13T08:05:50.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf008e8d0 con 0x7efdf0091740 2026-02-13T08:05:50.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf008ebb0 con 0x7efdf013fcd0 2026-02-13T08:05:50.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 Processor -- start 2026-02-13T08:05:50.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdee575640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7efdf013f870 0x7efdf0180690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42234/0 (socket says 10.20.193.104:42234) 2026-02-13T08:05:50.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdee575640 1 -- 10.20.193.104:0/3875757189 learned_addr learned my addr 10.20.193.104:0/3875757189 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient(hunting): authenticate will time out at 456.040130s 2026-02-13T08:05:50.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 -- start start 2026-02-13T08:05:50.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 librados: setting wanted keys 2026-02-13T08:05:50.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 librados: calling monclient init 2026-02-13T08:05:50.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient: init 2026-02-13T08:05:50.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 -- 10.20.193.104:0/3875757189 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418412123 0 0) 0x7efdf008ebb0 con 0x7efdf013fcd0 2026-02-13T08:05:50.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient(hunting): my global_id is 4325 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 -- 10.20.193.104:0/3875757189 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efddc003620 con 0x7efdf013fcd0 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 -- 10.20.193.104:0/3875757189 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1331975617 0 0) 0x7efdf008e5f0 con 0x7efdf013f870 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient(hunting): my global_id is 4341 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 -- 10.20.193.104:0/3875757189 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf008ebb0 con 0x7efdf013f870 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 -- 10.20.193.104:0/3875757189 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3084647958 0 0) 0x7efddc003620 con 0x7efdf013fcd0 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 -- 10.20.193.104:0/3875757189 >> v1:10.20.193.119:6789/0 conn(0x7efdf0091740 legacy=0x7efdf013f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 -- 10.20.193.104:0/3875757189 >> v1:10.20.193.104:6789/0 conn(0x7efdf013f870 legacy=0x7efdf0180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 monclient: found mon.noname-b 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 -- 10.20.193.104:0/3875757189 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf0091b10 con 0x7efdf013fcd0 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 -- 10.20.193.104:0/3875757189 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7efde0003180 con 0x7efdf013fcd0 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient: dump: 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.484 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.485 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.485 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.485 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 5 monclient: authenticate success, global_id 4325 2026-02-13T08:05:50.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:50.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:50.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient(hunting): picked mon.noname-c con 0x7f125008c7e0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient(hunting): picked mon.noname-a con 0x7f125008cbe0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient(hunting): picked mon.noname-b con 0x7f1250090840 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f125012d660 con 0x7f125008cbe0 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f125012d940 con 0x7f1250090840 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12501a5f60 con 0x7f125008c7e0 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient(hunting): authenticate will time out at 456.040512s 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 -- 10.20.193.104:0/3875757189 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efde0003390 con 0x7efdf013fcd0 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 1 -- 10.20.193.104:0/3875757189 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7efde00037d0 con 0x7efdf013fcd0 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdedd74640 10 monclient: dump: 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.486 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 4 set_mon_vals no callback set 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1255c45640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f125008c7e0 0x7f125013edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40720/0 (socket says 10.20.193.104:40720) 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1255444640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f125008cbe0 0x7f125018dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42250/0 (socket says 10.20.193.104:42250) 2026-02-13T08:05:50.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1255c45640 1 -- 10.20.193.104:0/423451125 learned_addr learned my addr 10.20.193.104:0/423451125 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: shutdown 2026-02-13T08:05:50.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- 10.20.193.104:0/3862536837 >> v1:10.20.193.104:6789/0 conn(0x7f0c1813f820 legacy=0x7f0c181806b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 client.?.objecter ms_handle_connect 0x7f125008c7e0 2026-02-13T08:05:50.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 client.?.objecter ms_handle_connect 0x7f125008cbe0 2026-02-13T08:05:50.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- 10.20.193.104:0/3862536837 shutdown_connections 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- 10.20.193.104:0/3862536837 >> 10.20.193.104:0/3862536837 conn(0x7f0c180908f0 msgr2=0x7f0c18051880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- 10.20.193.104:0/3862536837 shutdown_connections 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- 10.20.193.104:0/3862536837 wait complete. 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526024509 0 0) 0x7f125012d660 con 0x7f125008cbe0 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): my global_id is 4344 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1220003620 con 0x7f125008cbe0 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1094281010 0 0) 0x7f12501a5f60 con 0x7f125008c7e0 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): my global_id is 4328 2026-02-13T08:05:50.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f125012d660 con 0x7f125008c7e0 2026-02-13T08:05:50.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: shutdown 2026-02-13T08:05:50.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- 10.20.193.104:0/3875757189 >> v1:10.20.193.104:6790/0 conn(0x7efdf013fcd0 legacy=0x7efdf01a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 574721542 0 0) 0x7f1220003620 con 0x7f125008cbe0 2026-02-13T08:05:50.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12501a5f60 con 0x7f125008cbe0 2026-02-13T08:05:50.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- 10.20.193.104:0/3875757189 shutdown_connections 2026-02-13T08:05:50.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- 10.20.193.104:0/3875757189 >> 10.20.193.104:0/3875757189 conn(0x7efdf0090810 msgr2=0x7efdf0090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f12440033a0 con 0x7f125008cbe0 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): dump: 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:50.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- 10.20.193.104:0/3875757189 shutdown_connections 2026-02-13T08:05:50.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- 10.20.193.104:0/3875757189 wait complete. 2026-02-13T08:05:50.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 client.?.objecter ms_handle_connect 0x7f1250090840 2026-02-13T08:05:50.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 947980919 0 0) 0x7f125012d660 con 0x7f125008c7e0 2026-02-13T08:05:50.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1220003620 con 0x7f125008c7e0 2026-02-13T08:05:50.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f12400031a0 con 0x7f125008c7e0 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient(hunting): dump: 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 44830440 0 0) 0x7f12501a5f60 con 0x7f125008cbe0 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 >> v1:10.20.193.104:6790/0 conn(0x7f125008c7e0 legacy=0x7f125013edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 >> v1:10.20.193.119:6789/0 conn(0x7f1250090840 legacy=0x7f125018f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 monclient: found mon.a 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125005d6c0 con 0x7f125008cbe0 2026-02-13T08:05:50.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 5 monclient: authenticate success, global_id 4344 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient: _renew_subs 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 -- 10.20.193.104:0/423451125 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f125012dc20 con 0x7f125008cbe0 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 client.4344.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient: _renew_subs 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 -- 10.20.193.104:0/423451125 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f125012c440 con 0x7f125008cbe0 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 librados: init done 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1244003030 con 0x7f125008cbe0 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1244004c30 con 0x7f125008cbe0 2026-02-13T08:05:50.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: monmap: 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 monclient: dump: 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.495 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123ffff640 4 set_mon_vals no callback set 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 librados: starting msgr at 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 librados: starting objecter 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 Processor -- start 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: monmap: 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:50.496 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- start start 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 librados: setting wanted keys 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 librados: calling monclient init 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: init 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 librados: starting msgr at 2026-02-13T08:05:50.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 librados: starting objecter 2026-02-13T08:05:50.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1257ed0640 1 -- 10.20.193.104:0/423451125 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1250061860 con 0x7f125008cbe0 2026-02-13T08:05:50.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 Processor -- start 2026-02-13T08:05:50.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:50.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- start start 2026-02-13T08:05:50.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 librados: setting wanted keys 2026-02-13T08:05:50.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 librados: calling monclient init 2026-02-13T08:05:50.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: init 2026-02-13T08:05:50.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient(hunting): picked mon.noname-a con 0x7f0c1813f820 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient(hunting): picked mon.noname-c con 0x7f0c1813fca0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f1244010c40 con 0x7f125008cbe0 2026-02-13T08:05:50.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient(hunting): picked mon.noname-b con 0x7f0c181917c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1812fb90 con 0x7f0c1813f820 2026-02-13T08:05:50.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c1812cb90 con 0x7f0c181917c0 2026-02-13T08:05:50.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c18059170 con 0x7f0c1813fca0 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient(hunting): authenticate will time out at 456.041550s 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1d6d9640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f0c1813f820 0x7f0c1812bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42260/0 (socket says 10.20.193.104:42260) 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1d6d9640 1 -- 10.20.193.104:0/1131621608 learned_addr learned my addr 10.20.193.104:0/1131621608 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1ced8640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f0c1813fca0 0x7f0c1812c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40734/0 (socket says 10.20.193.104:40734) 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 client.?.objecter ms_handle_connect 0x7f0c1813f820 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 client.?.objecter ms_handle_connect 0x7f0c1813fca0 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f124404a0f0 con 0x7f125008cbe0 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 client.4344.objecter ms_dispatch2 0x7f1250000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 3 client.4344.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 3 client.4344.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:50.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient(hunting): picked mon.noname-c con 0x7efdf0091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient(hunting): picked mon.noname-a con 0x7efdf013f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1622148228 0 0) 0x7f0c18059170 con 0x7f0c1813fca0 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient(hunting): my global_id is 4331 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient(hunting): picked mon.noname-b con 0x7efdf013fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf008d970 con 0x7efdf013f870 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf012fbc0 con 0x7efdf013fcd0 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 20 client.4344.objecter dump_active .. 0 homeless 2026-02-13T08:05:50.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0be8003620 con 0x7f0c1813fca0 2026-02-13T08:05:50.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdf013f460 con 0x7efdf0091740 2026-02-13T08:05:50.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient(hunting): authenticate will time out at 456.041770s 2026-02-13T08:05:50.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdeed76640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7efdf0091740 0x7efdf014f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40740/0 (socket says 10.20.193.104:40740) 2026-02-13T08:05:50.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdeed76640 1 -- 10.20.193.104:0/865331414 learned_addr learned my addr 10.20.193.104:0/865331414 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdee575640 1 --1- 10.20.193.104:0/865331414 >> v1:10.20.193.104:6789/0 conn(0x7efdf013f870 0x7efdf01909c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42274/0 (socket says 10.20.193.104:42274) 2026-02-13T08:05:50.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 client.?.objecter ms_handle_connect 0x7efdf0091740 2026-02-13T08:05:50.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f1255c45640 10 monclient: get_auth_request con 0x7f122003b870 auth_method 0 2026-02-13T08:05:50.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 client.?.objecter ms_handle_connect 0x7efdf013f870 2026-02-13T08:05:50.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4259994519 0 0) 0x7f0be8003620 con 0x7f0c1813fca0 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c18059170 con 0x7f0c1813fca0 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 client.?.objecter ms_handle_connect 0x7f0c181917c0 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0c0c003390 con 0x7f0c1813fca0 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134306997 0 0) 0x7efdf013f460 con 0x7efdf0091740 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.504 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:50.504 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.504 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient(hunting): my global_id is 4334 2026-02-13T08:05:50.504 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdbc003620 con 0x7efdf0091740 2026-02-13T08:05:50.504 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4010358037 0 0) 0x7f0c18059170 con 0x7f0c1813fca0 2026-02-13T08:05:50.504 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 >> v1:10.20.193.119:6789/0 conn(0x7f0c181917c0 legacy=0x7f0c18191c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.504 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 >> v1:10.20.193.104:6789/0 conn(0x7f0c1813f820 legacy=0x7f0c1812bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.504 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.504 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 client.?.objecter ms_handle_connect 0x7efdf013fcd0 2026-02-13T08:05:50.504 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 monclient: found mon.c 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c1808a9e0 con 0x7f0c1813fca0 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3613409876 0 0) 0x7efdbc003620 con 0x7efdf0091740 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdf013f460 con 0x7efdf0091740 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7efde40031a0 con 0x7efdf0091740 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:50.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 5 monclient: authenticate success, global_id 4331 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: _renew_subs 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- 10.20.193.104:0/1131621608 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0c1812ed20 con 0x7f0c1813fca0 2026-02-13T08:05:50.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f123e7fc640 10 client.4344.objecter ms_handle_connect 0x7f122003b870 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 client.4331.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: _renew_subs 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- 10.20.193.104:0/1131621608 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0c1813f4d0 con 0x7f0c1813fca0 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 librados: init done 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1696334718 0 0) 0x7efdf013f460 con 0x7efdf0091740 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 >> v1:10.20.193.119:6789/0 conn(0x7efdf013fcd0 legacy=0x7efdf01920e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 >> v1:10.20.193.104:6789/0 conn(0x7efdf013f870 legacy=0x7efdf01909c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 monclient: found mon.c 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf012db40 con 0x7efdf0091740 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c0c002f80 con 0x7f0c1813fca0 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 5 monclient: authenticate success, global_id 4334 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: _renew_subs 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- 10.20.193.104:0/865331414 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efdf012f660 con 0x7efdf0091740 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0c0c004dd0 con 0x7f0c1813fca0 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 monclient: dump: 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c077fe640 4 set_mon_vals no callback set 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 client.4334.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: _renew_subs 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- 10.20.193.104:0/865331414 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7efdf008ad00 con 0x7efdf0091740 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 librados: init done 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efde4003a00 con 0x7efdf0091740 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7efde4003c30 con 0x7efdf0091740 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 monclient: dump: 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efded573640 4 set_mon_vals no callback set 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1f964640 1 -- 10.20.193.104:0/1131621608 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c18061860 con 0x7f0c1813fca0 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdf5039640 1 -- 10.20.193.104:0/865331414 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf0061860 con 0x7efdf0091740 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f0c0c010de0 con 0x7f0c1813fca0 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7efde4003dd0 con 0x7efdf0091740 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f0c0c04a1d0 con 0x7f0c1813fca0 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 client.4331.objecter ms_dispatch2 0x7f0c18000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 3 client.4331.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 3 client.4331.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7efde404a380 con 0x7efdf0091740 2026-02-13T08:05:50.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 client.4334.objecter ms_dispatch2 0x7efdf0000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 3 client.4334.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 3 client.4334.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 20 client.4331.objecter dump_active .. 0 homeless 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 20 client.4334.objecter dump_active .. 0 homeless 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c1d6d9640 10 monclient: get_auth_request con 0x7f0be803b7a0 auth_method 0 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdee575640 10 monclient: get_auth_request con 0x7efdbc03b850 auth_method 0 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 10 monclient: get_monmap_and_config 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 10 monclient: monmap: 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:50.455119+0000 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:50.455119+0000 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.511 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f0c05ffb640 10 client.4331.objecter ms_handle_connect 0x7f0be803b7a0 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7efdcf7fe640 10 client.4334.objecter ms_handle_connect 0x7efdbc03b850 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 1 Processor -- start 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 1 -- start start 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 10 monclient: init 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 10 monclient(hunting): picked mon.noname-a con 0x7f4d0408fc20 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 10 monclient(hunting): picked mon.noname-b con 0x7f4d0413f820 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 10 monclient(hunting): picked mon.noname-c con 0x7f4d0413fca0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0408ecd0 con 0x7f4d0408fc20 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0408e710 con 0x7f4d0413fca0 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0408e9f0 con 0x7f4d0413f820 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0c5e0640 10 monclient(hunting): authenticate will time out at 456.043807s 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d09b54640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f4d0413f820 0x7f4d041806b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40742/0 (socket says 10.20.193.104:40742) 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d09b54640 1 -- 10.20.193.104:0/2863501813 learned_addr learned my addr 10.20.193.104:0/2863501813 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d0a355640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f4d0408fc20 0x7f4d0413f110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42290/0 (socket says 10.20.193.104:42290) 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d09353640 1 -- 10.20.193.104:0/2863501813 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286568368 0 0) 0x7f4d0408ecd0 con 0x7f4d0408fc20 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d09353640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d09353640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d09353640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.448+0000 7f4d09353640 10 monclient(hunting): my global_id is 4347 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 1 -- 10.20.193.104:0/2863501813 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cec003620 con 0x7f4d0408fc20 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f1244016b90 con 0x7f125008cbe0 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f123e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f123e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:50.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 1 -- 10.20.193.104:0/2863501813 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4121651032 0 0) 0x7f4cec003620 con 0x7f4d0408fc20 2026-02-13T08:05:50.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 1 -- 10.20.193.104:0/2863501813 >> v1:10.20.193.104:6790/0 conn(0x7f4d0413f820 legacy=0x7f4d041806b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 1 -- 10.20.193.104:0/2863501813 >> v1:10.20.193.119:6789/0 conn(0x7f4d0413fca0 legacy=0x7f4d041a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 1 monclient: found mon.noname-a 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 1 -- 10.20.193.104:0/2863501813 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d040521f0 con 0x7f4d0408fc20 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 1 -- 10.20.193.104:0/2863501813 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4cf4002e00 con 0x7f4d0408fc20 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 10 monclient: dump: 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 5 monclient: authenticate success, global_id 4347 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 1 -- 10.20.193.104:0/2863501813 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4cf4003080 con 0x7f4d0408fc20 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 1 -- 10.20.193.104:0/2863501813 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4cf40034c0 con 0x7f4d0408fc20 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d09353640 10 monclient: dump: 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.515 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 4 set_mon_vals no callback set 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: shutdown 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2863501813 >> v1:10.20.193.104:6789/0 conn(0x7f4d0408fc20 legacy=0x7f4d0413f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2863501813 shutdown_connections 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2863501813 >> 10.20.193.104:0/2863501813 conn(0x7f4d040908f0 msgr2=0x7f4d04051880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2863501813 shutdown_connections 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2863501813 wait complete. 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: monmap: 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 librados: starting msgr at 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 librados: starting objecter 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 Processor -- start 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- start start 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 librados: setting wanted keys 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 librados: calling monclient init 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: init 2026-02-13T08:05:50.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient(hunting): picked mon.noname-c con 0x7f4d0413f820 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient(hunting): picked mon.noname-a con 0x7f4d0413fca0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient(hunting): picked mon.noname-b con 0x7f4d041919f0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0412ee00 con 0x7f4d0413fca0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0412f3d0 con 0x7f4d041919f0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0408a9e0 con 0x7f4d0413f820 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient(hunting): authenticate will time out at 456.045599s 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0a355640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f4d0413f820 0x7f4d0412be50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40752/0 (socket says 10.20.193.104:40752) 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0a355640 1 -- 10.20.193.104:0/2041533075 learned_addr learned my addr 10.20.193.104:0/2041533075 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 client.?.objecter ms_handle_connect 0x7f4d0413f820 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 client.?.objecter ms_handle_connect 0x7f4d0413fca0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 943733950 0 0) 0x7f4d0412ee00 con 0x7f4d0413fca0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient(hunting): my global_id is 4350 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cd4003620 con 0x7f4d0413fca0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4068447180 0 0) 0x7f4cd4003620 con 0x7f4d0413fca0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d0412ee00 con 0x7f4d0413fca0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4cf8002f60 con 0x7f4d0413fca0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient(hunting): dump: 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.517 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 client.?.objecter ms_handle_connect 0x7f4d041919f0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1506647451 0 0) 0x7f4d0412ee00 con 0x7f4d0413fca0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 >> v1:10.20.193.104:6790/0 conn(0x7f4d0413f820 legacy=0x7f4d0412be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 >> v1:10.20.193.119:6789/0 conn(0x7f4d041919f0 legacy=0x7f4d04191e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 monclient: found mon.a 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0412cc70 con 0x7f4d0413fca0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 5 monclient: authenticate success, global_id 4350 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: _renew_subs 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2041533075 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d04130120 con 0x7f4d0413fca0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 client.4350.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: _renew_subs 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2041533075 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d0408a200 con 0x7f4d0413fca0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 librados: init done 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4cf80048e0 con 0x7f4d0413fca0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4cf8004b50 con 0x7f4d0413fca0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 monclient: dump: 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.518 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d08b52640 4 set_mon_vals no callback set 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2041533075 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0413f5b0 con 0x7f4d0413fca0 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f4cf8004cf0 con 0x7f4d0413fca0 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f0c0c016cd0 con 0x7f0c1813fca0 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f0c05ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f0c05ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7f4cf804a240 con 0x7f4d0413fca0 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 client.4350.objecter ms_dispatch2 0x7f4d04000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 3 client.4350.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 3 client.4350.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 20 client.4350.objecter dump_active .. 0 homeless 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4d0a355640 10 monclient: get_auth_request con 0x7f4cd403b830 auth_method 0 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.452+0000 7f4ceaffd640 10 client.4350.objecter ms_handle_connect 0x7f4cd403b830 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.456+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f4cf8016c80 con 0x7f4d0413fca0 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.456+0000 7f4ceaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.456+0000 7f4ceaffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:50.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.456+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7efdf012f660 con 0x7efdf0091740 2026-02-13T08:05:50.520 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.456+0000 7efdcf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.520 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.456+0000 7efdcf7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient: get_monmap_and_config 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient: monmap: 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:50.469591+0000 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:50.469591+0000 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:50.522 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 Processor -- start 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 -- start start 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient: init 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient(hunting): picked mon.noname-b con 0x7efff4091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient(hunting): picked mon.noname-a con 0x7efff413f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient(hunting): picked mon.noname-c con 0x7efff413fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efff408e5f0 con 0x7efff413f870 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efff408e8d0 con 0x7efff413fcd0 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efff408ebb0 con 0x7efff4091740 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient(hunting): authenticate will time out at 456.058564s 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efff9479640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7efff4091740 0x7efff413f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40756/0 (socket says 10.20.193.104:40756) 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efff9479640 1 -- 10.20.193.104:0/997904395 learned_addr learned my addr 10.20.193.104:0/997904395 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 -- 10.20.193.104:0/997904395 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609605655 0 0) 0x7efff408ebb0 con 0x7efff4091740 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient(hunting): my global_id is 4337 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 -- 10.20.193.104:0/997904395 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effdc003620 con 0x7efff4091740 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 -- 10.20.193.104:0/997904395 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520416752 0 0) 0x7efff408e5f0 con 0x7efff413f870 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient(hunting): my global_id is 4353 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 -- 10.20.193.104:0/997904395 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efff408ebb0 con 0x7efff413f870 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 -- 10.20.193.104:0/997904395 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3197146087 0 0) 0x7efff408ebb0 con 0x7efff413f870 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 -- 10.20.193.104:0/997904395 >> v1:10.20.193.104:6790/0 conn(0x7efff4091740 legacy=0x7efff413f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 -- 10.20.193.104:0/997904395 >> v1:10.20.193.119:6789/0 conn(0x7efff413fcd0 legacy=0x7efff41a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 monclient: found mon.noname-a 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 -- 10.20.193.104:0/997904395 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff4091b10 con 0x7efff413f870 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 -- 10.20.193.104:0/997904395 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7effe8002e00 con 0x7efff413f870 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient: dump: 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 5 monclient: authenticate success, global_id 4353 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 -- 10.20.193.104:0/997904395 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effe8002fd0 con 0x7efff413f870 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 1 -- 10.20.193.104:0/997904395 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7effe8003410 con 0x7efff413f870 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7effe3fff640 10 monclient: dump: 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 4 set_mon_vals no callback set 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient: shutdown 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 -- 10.20.193.104:0/997904395 >> v1:10.20.193.104:6789/0 conn(0x7efff413f870 legacy=0x7efff4180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 -- 10.20.193.104:0/997904395 shutdown_connections 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 -- 10.20.193.104:0/997904395 >> 10.20.193.104:0/997904395 conn(0x7efff4090810 msgr2=0x7efff4090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 -- 10.20.193.104:0/997904395 shutdown_connections 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 -- 10.20.193.104:0/997904395 wait complete. 2026-02-13T08:05:50.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient: monmap: 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 librados: starting msgr at 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 librados: starting objecter 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 Processor -- start 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 -- start start 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 librados: setting wanted keys 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 1 librados: calling monclient init 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.464+0000 7efffb704640 10 monclient: init 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient(hunting): picked mon.noname-c con 0x7efff4091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient(hunting): picked mon.noname-b con 0x7efff413f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient(hunting): picked mon.noname-a con 0x7efff413fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efff412fad0 con 0x7efff413fcd0 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efff412cad0 con 0x7efff413f870 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efff408ab30 con 0x7efff4091740 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient(hunting): authenticate will time out at 456.060174s 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efff9479640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7efff4091740 0x7efff412bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40760/0 (socket says 10.20.193.104:40760) 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efff9479640 1 -- 10.20.193.104:0/2145886510 learned_addr learned my addr 10.20.193.104:0/2145886510 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 client.?.objecter ms_handle_connect 0x7efff413fcd0 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 client.?.objecter ms_handle_connect 0x7efff4091740 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186229137 0 0) 0x7efff408ab30 con 0x7efff4091740 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): my global_id is 4340 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc4003620 con 0x7efff4091740 2026-02-13T08:05:50.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933224892 0 0) 0x7efff412fad0 con 0x7efff413fcd0 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): my global_id is 4356 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efff408ab30 con 0x7efff413fcd0 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 client.?.objecter ms_handle_connect 0x7efff413f870 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1029997008 0 0) 0x7effc4003620 con 0x7efff4091740 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efff412fad0 con 0x7efff4091740 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7effe4002900 con 0x7efff4091740 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3891596644 0 0) 0x7efff408ab30 con 0x7efff413fcd0 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effc4003620 con 0x7efff413fcd0 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7efff0002fd0 con 0x7efff413fcd0 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612518066 0 0) 0x7efff412cad0 con 0x7efff413f870 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient(hunting): my global_id is 4327 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efff408ab30 con 0x7efff413f870 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 242246681 0 0) 0x7efff412fad0 con 0x7efff4091740 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 >> v1:10.20.193.119:6789/0 conn(0x7efff413f870 legacy=0x7efff412c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 >> v1:10.20.193.104:6789/0 conn(0x7efff413fcd0 legacy=0x7efff41917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 monclient: found mon.c 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff412ec60 con 0x7efff4091740 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 5 monclient: authenticate success, global_id 4340 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient: _renew_subs 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 1 -- 10.20.193.104:0/2145886510 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efff412f7f0 con 0x7efff4091740 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 client.4340.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient: _renew_subs 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 1 -- 10.20.193.104:0/2145886510 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7efff413f410 con 0x7efff4091740 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 1 librados: init done 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effe40048e0 con 0x7efff4091740 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7effe4004a90 con 0x7efff4091740 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient: dump: 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe37fe640 4 set_mon_vals no callback set 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efffb704640 1 -- 10.20.193.104:0/2145886510 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff4061860 con 0x7efff4091740 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7effe4010aa0 con 0x7efff4091740 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (unknown 412794498 0 0) 0x7effe404a1f0 con 0x7efff4091740 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 client.4340.objecter ms_dispatch2 0x7efff4000ba0 osd_map(18..18 src has 1..18) 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 3 client.4340.objecter handle_osd_map got epochs [18,18] > 0 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 3 client.4340.objecter handle_osd_map decoding full epoch 18 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 20 client.4340.objecter dump_active .. 0 homeless 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7efff8c78640 10 monclient: get_auth_request con 0x7effc403bc30 auth_method 0 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 client.4340.objecter ms_handle_connect 0x7effc403bc30 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7effe4016bd0 con 0x7efff4091740 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.468+0000 7effe1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 1 -- 10.20.193.104:0/810467657 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f15d412f7e0 con 0x7f15d4091740 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15d0ff9640 1 -- 10.20.193.104:0/810467657 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 847495621) 0x7f15c00165e0 con 0x7f15d4091740 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15d0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15d0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:50.528 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 10 librados: watch_flush enter 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 10 librados: watch_flush exit 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 20 client.4332.objecter shutdown clearing up homeless session... 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 10 client.4332.objecter successfully canceled tick 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 1 -- 10.20.193.104:0/810467657 >> v1:10.20.193.119:6812/276487904 conn(0x7f15a403b8a0 legacy=0x7f15a405bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 10 monclient: shutdown 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 1 -- 10.20.193.104:0/810467657 >> v1:10.20.193.104:6789/0 conn(0x7f15d4091740 legacy=0x7f15d412bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 1 -- 10.20.193.104:0/810467657 shutdown_connections 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 1 -- 10.20.193.104:0/810467657 >> 10.20.193.104:0/810467657 conn(0x7f15d4090810 msgr2=0x7f15d408beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 1 -- 10.20.193.104:0/810467657 shutdown_connections 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 1 -- 10.20.193.104:0/810467657 wait complete. 2026-02-13T08:05:50.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.516+0000 7f15da5e9640 1 librados: shutdown 2026-02-13T08:05:50.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.0 2026-02-13T08:05:50.536 DEBUG:teuthology.parallel:result is None 2026-02-13T08:05:50.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T08:05:50.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T08:05:50.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 1 -- 10.20.193.104:0/423451125 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f12501a3610 con 0x7f125008cbe0 2026-02-13T08:05:50.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f123e7fc640 1 -- 10.20.193.104:0/423451125 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 847495621) 0x7f124401bab0 con 0x7f125008cbe0 2026-02-13T08:05:50.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f123e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-13T08:05:50.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f123e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:50.544 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:50.545 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 10 librados: watch_flush enter 2026-02-13T08:05:50.545 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 10 librados: watch_flush exit 2026-02-13T08:05:50.545 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 20 client.4344.objecter shutdown clearing up homeless session... 2026-02-13T08:05:50.545 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 10 client.4344.objecter successfully canceled tick 2026-02-13T08:05:50.545 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 1 -- 10.20.193.104:0/423451125 >> v1:10.20.193.119:6812/276487904 conn(0x7f122003b870 legacy=0x7f122005bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.545 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 10 monclient: shutdown 2026-02-13T08:05:50.546 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.546 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 1 -- 10.20.193.104:0/423451125 >> v1:10.20.193.104:6789/0 conn(0x7f125008cbe0 legacy=0x7f125018dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.546 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 1 -- 10.20.193.104:0/423451125 shutdown_connections 2026-02-13T08:05:50.546 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 1 -- 10.20.193.104:0/423451125 >> 10.20.193.104:0/423451125 conn(0x7f125008e1d0 msgr2=0x7f12501a4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.546 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 1 -- 10.20.193.104:0/423451125 shutdown_connections 2026-02-13T08:05:50.546 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 1 -- 10.20.193.104:0/423451125 wait complete. 2026-02-13T08:05:50.546 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.536+0000 7f1257ed0640 1 librados: shutdown 2026-02-13T08:05:50.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T08:05:50.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T08:05:50.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 1 -- 10.20.193.104:0/1131621608 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f0c1812e5f0 con 0x7f0c1813fca0 2026-02-13T08:05:50.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c05ffb640 1 -- 10.20.193.104:0/1131621608 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 847495621) 0x7f0c0c0165d0 con 0x7f0c1813fca0 2026-02-13T08:05:50.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c05ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-13T08:05:50.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c05ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:50.547 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 10 librados: watch_flush enter 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 10 librados: watch_flush exit 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 20 client.4331.objecter shutdown clearing up homeless session... 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 10 client.4331.objecter successfully canceled tick 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 1 -- 10.20.193.104:0/1131621608 >> v1:10.20.193.119:6812/276487904 conn(0x7f0be803b7a0 legacy=0x7f0be805bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 10 monclient: shutdown 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 1 -- 10.20.193.104:0/1131621608 >> v1:10.20.193.104:6790/0 conn(0x7f0c1813fca0 legacy=0x7f0c1812c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 1 -- 10.20.193.104:0/1131621608 shutdown_connections 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 1 -- 10.20.193.104:0/1131621608 >> 10.20.193.104:0/1131621608 conn(0x7f0c180908f0 msgr2=0x7f0c180898d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 1 -- 10.20.193.104:0/1131621608 shutdown_connections 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 1 -- 10.20.193.104:0/1131621608 wait complete. 2026-02-13T08:05:50.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.540+0000 7f0c1f964640 1 librados: shutdown 2026-02-13T08:05:50.550 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T08:05:50.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T08:05:50.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 1 -- 10.20.193.104:0/865331414 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efdf01500d0 con 0x7efdf0091740 2026-02-13T08:05:50.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdcf7fe640 1 -- 10.20.193.104:0/865331414 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 847495621) 0x7efde4016dc0 con 0x7efdf0091740 2026-02-13T08:05:50.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdcf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-13T08:05:50.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdcf7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:50.551 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:50.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T08:05:50.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T08:05:50.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.552 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2041533075 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4d0412f610 con 0x7f4d0413fca0 2026-02-13T08:05:50.552 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4ceaffd640 1 -- 10.20.193.104:0/2041533075 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 847495621) 0x7f4cf8016580 con 0x7f4d0413fca0 2026-02-13T08:05:50.552 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4ceaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-13T08:05:50.552 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4ceaffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:50.552 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 10 librados: watch_flush enter 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 10 librados: watch_flush exit 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 20 client.4334.objecter shutdown clearing up homeless session... 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 10 client.4334.objecter successfully canceled tick 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 1 -- 10.20.193.104:0/865331414 >> v1:10.20.193.119:6812/276487904 conn(0x7efdbc03b850 legacy=0x7efdbc05bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 10 monclient: shutdown 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 1 -- 10.20.193.104:0/865331414 >> v1:10.20.193.104:6790/0 conn(0x7efdf0091740 legacy=0x7efdf014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 1 -- 10.20.193.104:0/865331414 shutdown_connections 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 1 -- 10.20.193.104:0/865331414 >> 10.20.193.104:0/865331414 conn(0x7efdf0090810 msgr2=0x7efdf008c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 1 -- 10.20.193.104:0/865331414 shutdown_connections 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 1 -- 10.20.193.104:0/865331414 wait complete. 2026-02-13T08:05:50.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7efdf5039640 1 librados: shutdown 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 10 librados: watch_flush enter 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 10 librados: watch_flush exit 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 20 client.4350.objecter shutdown clearing up homeless session... 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 10 client.4350.objecter successfully canceled tick 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2041533075 >> v1:10.20.193.119:6812/276487904 conn(0x7f4cd403b830 legacy=0x7f4cd405bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 10 monclient: shutdown 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2041533075 >> v1:10.20.193.104:6789/0 conn(0x7f4d0413fca0 legacy=0x7f4d0412c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2041533075 shutdown_connections 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2041533075 >> 10.20.193.104:0/2041533075 conn(0x7f4d040908f0 msgr2=0x7f4d04089af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2041533075 shutdown_connections 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 1 -- 10.20.193.104:0/2041533075 wait complete. 2026-02-13T08:05:50.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.544+0000 7f4d0c5e0640 1 librados: shutdown 2026-02-13T08:05:50.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.4 2026-02-13T08:05:50.557 DEBUG:teuthology.parallel:result is None 2026-02-13T08:05:50.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.2 2026-02-13T08:05:50.560 DEBUG:teuthology.parallel:result is None 2026-02-13T08:05:50.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T08:05:50.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T08:05:50.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 1 -- 10.20.193.104:0/2145886510 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efff4088990 con 0x7efff4091740 2026-02-13T08:05:50.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7effe1ffb640 1 -- 10.20.193.104:0/2145886510 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 847495621) 0x7effe40164d0 con 0x7efff4091740 2026-02-13T08:05:50.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7effe1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-13T08:05:50.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7effe1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:50.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.3 2026-02-13T08:05:50.565 INFO:teuthology.orchestra.run.trial104.stdout:47244640259 2026-02-13T08:05:50.565 DEBUG:teuthology.parallel:result is None 2026-02-13T08:05:50.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.5 2026-02-13T08:05:50.566 DEBUG:teuthology.parallel:result is None 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 10 librados: watch_flush enter 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 10 librados: watch_flush exit 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 20 client.4340.objecter shutdown clearing up homeless session... 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 10 client.4340.objecter successfully canceled tick 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 1 -- 10.20.193.104:0/2145886510 >> v1:10.20.193.119:6812/276487904 conn(0x7effc403bc30 legacy=0x7effc405c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 10 monclient: shutdown 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 1 -- 10.20.193.104:0/2145886510 >> v1:10.20.193.104:6790/0 conn(0x7efff4091740 legacy=0x7efff412bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 1 -- 10.20.193.104:0/2145886510 shutdown_connections 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 1 -- 10.20.193.104:0/2145886510 >> 10.20.193.104:0/2145886510 conn(0x7efff4090810 msgr2=0x7efff4057f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 1 -- 10.20.193.104:0/2145886510 shutdown_connections 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 1 -- 10.20.193.104:0/2145886510 wait complete. 2026-02-13T08:05:50.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.556+0000 7efffb704640 1 librados: shutdown 2026-02-13T08:05:50.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.1 2026-02-13T08:05:50.577 DEBUG:teuthology.parallel:result is None 2026-02-13T08:05:50.577 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-13T08:05:50.577 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T08:05:50.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.668+0000 7f2670592640 10 monclient: get_monmap_and_config 2026-02-13T08:05:50.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.668+0000 7f2670592640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.668+0000 7f2670592640 10 monclient: monmap: 2026-02-13T08:05:50.678 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.678 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.678 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:50.675655+0000 2026-02-13T08:05:50.679 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:50.675655+0000 2026-02-13T08:05:50.679 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.679 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.679 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.679 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:50.679 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:50.679 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 Processor -- start 2026-02-13T08:05:50.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- start start 2026-02-13T08:05:50.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: init 2026-02-13T08:05:50.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:50.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient(hunting): picked mon.noname-a con 0x7f266808fa20 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient(hunting): picked mon.noname-c con 0x7f266813fdc0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient(hunting): picked mon.noname-b con 0x7f2668181ca0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2668092d80 con 0x7f266808fa20 2026-02-13T08:05:50.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266808e8c0 con 0x7f266813fdc0 2026-02-13T08:05:50.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26680872c0 con 0x7f2668181ca0 2026-02-13T08:05:50.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient(hunting): authenticate will time out at 456.264605s 2026-02-13T08:05:50.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266e307640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f266808fa20 0x7f266813f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42334/0 (socket says 10.20.193.104:42334) 2026-02-13T08:05:50.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266e307640 1 -- 10.20.193.104:0/531799539 learned_addr learned my addr 10.20.193.104:0/531799539 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839516544 0 0) 0x7f26680872c0 con 0x7f2668181ca0 2026-02-13T08:05:50.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): my global_id is 4343 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2650003620 con 0x7f2668181ca0 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 339633821 0 0) 0x7f2658002850 con 0x7f266808fa20 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): my global_id is 4359 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26680872c0 con 0x7f266808fa20 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010622038 0 0) 0x7f265c002920 con 0x7f266813fdc0 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient(hunting): my global_id is 4330 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2658002850 con 0x7f266813fdc0 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2833054074 0 0) 0x7f2650003620 con 0x7f2668181ca0 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 >> v1:10.20.193.119:6789/0 conn(0x7f266813fdc0 legacy=0x7f2668180580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 >> v1:10.20.193.104:6789/0 conn(0x7f266808fa20 legacy=0x7f266813f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 monclient: found mon.noname-b 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266808fdf0 con 0x7f2668181ca0 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2664003180 con 0x7f2668181ca0 2026-02-13T08:05:50.691 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient: dump: 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.692 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 5 monclient: authenticate success, global_id 4343 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2664003320 con 0x7f2668181ca0 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 1 -- 10.20.193.104:0/531799539 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2664003760 con 0x7f2668181ca0 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266d305640 10 monclient: dump: 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.693 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 4 set_mon_vals no callback set 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: shutdown 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- 10.20.193.104:0/531799539 >> v1:10.20.193.104:6790/0 conn(0x7f2668181ca0 legacy=0x7f26681a2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- 10.20.193.104:0/531799539 shutdown_connections 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- 10.20.193.104:0/531799539 >> 10.20.193.104:0/531799539 conn(0x7f26680909b0 msgr2=0x7f2668090db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- 10.20.193.104:0/531799539 shutdown_connections 2026-02-13T08:05:50.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- 10.20.193.104:0/531799539 wait complete. 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: monmap: 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 librados: starting msgr at 2026-02-13T08:05:50.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 librados: starting objecter 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 Processor -- start 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- start start 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 librados: setting wanted keys 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 librados: calling monclient init 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: init 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient(hunting): picked mon.noname-b con 0x7f266808fa20 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient(hunting): picked mon.noname-c con 0x7f266813fdc0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient(hunting): picked mon.noname-a con 0x7f2668181ca0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266810e390 con 0x7f2668181ca0 2026-02-13T08:05:50.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f266812d8b0 con 0x7f266808fa20 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2668181a90 con 0x7f266813fdc0 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient(hunting): authenticate will time out at 456.267173s 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266db06640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f266813fdc0 0x7f266812d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40776/0 (socket says 10.20.193.104:40776) 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266db06640 1 -- 10.20.193.104:0/496580958 learned_addr learned my addr 10.20.193.104:0/496580958 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 client.?.objecter ms_handle_connect 0x7f266813fdc0 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 client.?.objecter ms_handle_connect 0x7f2668181ca0 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3349717681 0 0) 0x7f2668181a90 con 0x7f266813fdc0 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.697 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): my global_id is 4346 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2638003620 con 0x7f266813fdc0 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 client.?.objecter ms_handle_connect 0x7f266808fa20 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005874249 0 0) 0x7f266810e390 con 0x7f2668181ca0 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): my global_id is 4362 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2668181a90 con 0x7f2668181ca0 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301462293 0 0) 0x7f266812d8b0 con 0x7f266808fa20 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): my global_id is 4333 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f266810e390 con 0x7f266808fa20 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 417920305 0 0) 0x7f2638003620 con 0x7f266813fdc0 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f266812d8b0 con 0x7f266813fdc0 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f265c003270 con 0x7f266813fdc0 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): dump: 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.699 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2940808518 0 0) 0x7f2668181a90 con 0x7f2668181ca0 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2638003620 con 0x7f2668181ca0 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2664003670 con 0x7f2668181ca0 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient(hunting): dump: 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3587758068 0 0) 0x7f266812d8b0 con 0x7f266813fdc0 2026-02-13T08:05:50.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 >> v1:10.20.193.119:6789/0 conn(0x7f266808fa20 legacy=0x7f266812ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 >> v1:10.20.193.104:6789/0 conn(0x7f2668181ca0 legacy=0x7f2668181380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 monclient: found mon.c 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f266810d520 con 0x7f266813fdc0 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 5 monclient: authenticate success, global_id 4346 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: _renew_subs 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- 10.20.193.104:0/496580958 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f266810c030 con 0x7f266813fdc0 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 client.4346.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: _renew_subs 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 -- 10.20.193.104:0/496580958 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f266810cd60 con 0x7f266813fdc0 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f2670592640 1 librados: init done 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f265c003500 con 0x7f266813fdc0 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f265c003b60 con 0x7f266813fdc0 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f264effd640 10 monclient: dump: 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.703 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.672+0000 7f266cb04640 4 set_mon_vals no callback set 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f2670592640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f2670592640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f2670592640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f2670592640 1 -- 10.20.193.104:0/496580958 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f266810dba0 con 0x7f266813fdc0 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f265c003b60 con 0x7f266813fdc0 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f265c04a040 con 0x7f266813fdc0 2026-02-13T08:05:50.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f264effd640 10 client.4346.objecter ms_dispatch2 0x7f2668000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:50.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f264effd640 3 client.4346.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:50.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f264effd640 3 client.4346.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:50.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f264effd640 20 client.4346.objecter dump_active .. 0 homeless 2026-02-13T08:05:50.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f266e307640 10 monclient: get_auth_request con 0x7f263803b7e0 auth_method 0 2026-02-13T08:05:50.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.676+0000 7f264effd640 10 client.4346.objecter ms_handle_connect 0x7f263803b7e0 2026-02-13T08:05:50.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.680+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f266808e8c0 con 0x7f266813fdc0 2026-02-13T08:05:50.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.680+0000 7f264effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.680+0000 7f264effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:50.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.760+0000 7f2670592640 1 -- 10.20.193.104:0/496580958 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f26680380f0 con 0x7f263803b7e0 2026-02-13T08:05:50.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.760+0000 7f264effd640 1 -- 10.20.193.104:0/496580958 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34187 (unknown 2965378022 0 1399472304) 0x7f26680380f0 con 0x7f263803b7e0 2026-02-13T08:05:50.771 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:50.772 INFO:teuthology.orchestra.run.trial104.stderr:dumped all 2026-02-13T08:05:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 10 librados: watch_flush enter 2026-02-13T08:05:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 10 librados: watch_flush exit 2026-02-13T08:05:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 20 client.4346.objecter shutdown clearing up homeless session... 2026-02-13T08:05:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 10 client.4346.objecter successfully canceled tick 2026-02-13T08:05:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 1 -- 10.20.193.104:0/496580958 >> v1:10.20.193.119:6812/276487904 conn(0x7f263803b7e0 legacy=0x7f263805bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 10 monclient: shutdown 2026-02-13T08:05:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 1 -- 10.20.193.104:0/496580958 >> v1:10.20.193.104:6790/0 conn(0x7f266813fdc0 legacy=0x7f266812d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 1 -- 10.20.193.104:0/496580958 shutdown_connections 2026-02-13T08:05:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 1 -- 10.20.193.104:0/496580958 >> 10.20.193.104:0/496580958 conn(0x7f26680909b0 msgr2=0x7f266813f690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 1 -- 10.20.193.104:0/496580958 shutdown_connections 2026-02-13T08:05:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 1 -- 10.20.193.104:0/496580958 wait complete. 2026-02-13T08:05:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.764+0000 7f2670592640 1 librados: shutdown 2026-02-13T08:05:50.780 INFO:teuthology.orchestra.run.trial104.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-13T08:05:50.692381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162744,"kb_used_data":984,"kb_used_omap":43,"kb_used_meta":161620,"kb_avail":566068296,"statfs":{"total":579820584960,"available":579653935104,"internally_reserved":0,"allocated":1007616,"data_stored":1457434,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":44845,"internal_metadata":165499091},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.362883"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689616+0000","last_change":"2026-02-13T08:05:48.689722+0000","last_active":"2026-02-13T08:05:48.689616+0000","last_peered":"2026-02-13T08:05:48.689616+0000","last_clean":"2026-02-13T08:05:48.689616+0000","last_became_active":"2026-02-13T08:05:46.332518+0000","last_became_peered":"2026-02-13T08:05:46.332518+0000","last_unstale":"2026-02-13T08:05:48.689616+0000","last_undegraded":"2026-02-13T08:05:48.689616+0000","last_fullsized":"2026-02-13T08:05:48.689616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:47.031472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027820299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241193+0000","last_change":"2026-02-13T08:05:48.241308+0000","last_active":"2026-02-13T08:05:48.241193+0000","last_peered":"2026-02-13T08:05:48.241193+0000","last_clean":"2026-02-13T08:05:48.241193+0000","last_became_active":"2026-02-13T08:05:46.238040+0000","last_became_peered":"2026-02-13T08:05:46.238040+0000","last_unstale":"2026-02-13T08:05:48.241193+0000","last_undegraded":"2026-02-13T08:05:48.241193+0000","last_fullsized":"2026-02-13T08:05:48.241193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:05.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040397499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689589+0000","last_change":"2026-02-13T08:05:48.689720+0000","last_active":"2026-02-13T08:05:48.689589+0000","last_peered":"2026-02-13T08:05:48.689589+0000","last_clean":"2026-02-13T08:05:48.689589+0000","last_became_active":"2026-02-13T08:05:46.419763+0000","last_became_peered":"2026-02-13T08:05:46.419763+0000","last_unstale":"2026-02-13T08:05:48.689589+0000","last_undegraded":"2026-02-13T08:05:48.689589+0000","last_fullsized":"2026-02-13T08:05:48.689589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:11.120130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031193600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241158+0000","last_change":"2026-02-13T08:05:48.241321+0000","last_active":"2026-02-13T08:05:48.241158+0000","last_peered":"2026-02-13T08:05:48.241158+0000","last_clean":"2026-02-13T08:05:48.241158+0000","last_became_active":"2026-02-13T08:05:46.325615+0000","last_became_peered":"2026-02-13T08:05:46.325615+0000","last_unstale":"2026-02-13T08:05:48.241158+0000","last_undegraded":"2026-02-13T08:05:48.241158+0000","last_fullsized":"2026-02-13T08:05:48.241158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:50:27.013203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041541599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.335785+0000","last_change":"2026-02-13T08:05:48.335785+0000","last_active":"2026-02-13T08:05:48.335785+0000","last_peered":"2026-02-13T08:05:48.335785+0000","last_clean":"2026-02-13T08:05:48.335785+0000","last_became_active":"2026-02-13T08:05:46.332174+0000","last_became_peered":"2026-02-13T08:05:46.332174+0000","last_unstale":"2026-02-13T08:05:48.335785+0000","last_undegraded":"2026-02-13T08:05:48.335785+0000","last_fullsized":"2026-02-13T08:05:48.335785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:06.536002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000284605,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241612+0000","last_change":"2026-02-13T08:05:48.241731+0000","last_active":"2026-02-13T08:05:48.241612+0000","last_peered":"2026-02-13T08:05:48.241612+0000","last_clean":"2026-02-13T08:05:48.241612+0000","last_became_active":"2026-02-13T08:05:46.236660+0000","last_became_peered":"2026-02-13T08:05:46.236660+0000","last_unstale":"2026-02-13T08:05:48.241612+0000","last_undegraded":"2026-02-13T08:05:48.241612+0000","last_fullsized":"2026-02-13T08:05:48.241612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:54:09.509002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024995099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689748+0000","last_change":"2026-02-13T08:05:48.689871+0000","last_active":"2026-02-13T08:05:48.689748+0000","last_peered":"2026-02-13T08:05:48.689748+0000","last_clean":"2026-02-13T08:05:48.689748+0000","last_became_active":"2026-02-13T08:05:46.331895+0000","last_became_peered":"2026-02-13T08:05:46.331895+0000","last_unstale":"2026-02-13T08:05:48.689748+0000","last_undegraded":"2026-02-13T08:05:48.689748+0000","last_fullsized":"2026-02-13T08:05:48.689748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:19.373004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.335680+0000","last_change":"2026-02-13T08:05:48.335814+0000","last_active":"2026-02-13T08:05:48.335680+0000","last_peered":"2026-02-13T08:05:48.335680+0000","last_clean":"2026-02-13T08:05:48.335680+0000","last_became_active":"2026-02-13T08:05:46.331985+0000","last_became_peered":"2026-02-13T08:05:46.331985+0000","last_unstale":"2026-02-13T08:05:48.335680+0000","last_undegraded":"2026-02-13T08:05:48.335680+0000","last_fullsized":"2026-02-13T08:05:48.335680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:31:52.202154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030744700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":156,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689359+0000","last_change":"2026-02-13T08:05:43.034445+0000","last_active":"2026-02-13T08:05:48.689359+0000","last_peered":"2026-02-13T08:05:48.689359+0000","last_clean":"2026-02-13T08:05:48.689359+0000","last_became_active":"2026-02-13T08:05:43.032364+0000","last_became_peered":"2026-02-13T08:05:43.032364+0000","last_unstale":"2026-02-13T08:05:48.689359+0000","last_undegraded":"2026-02-13T08:05:48.689359+0000","last_fullsized":"2026-02-13T08:05:48.689359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_clean_scrub_stamp":"2026-02-13T08:05:41.931597+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:28.101837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":1180736,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6822,"internal_metadata":27583834},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":44720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":184,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":188416,"data_stored":631044,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":7473,"internal_metadata":27583183},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":192,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":196608,"data_stored":635088,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T08:05:50.782 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T08:05:50.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient: get_monmap_and_config 2026-02-13T08:05:50.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient: monmap: 2026-02-13T08:05:50.853 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.853 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.853 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:50.849796+0000 2026-02-13T08:05:50.853 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:50.849796+0000 2026-02-13T08:05:50.853 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.853 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.853 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.853 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:50.853 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:50.854 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 1 Processor -- start 2026-02-13T08:05:50.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 1 -- start start 2026-02-13T08:05:50.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient: init 2026-02-13T08:05:50.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:50.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient(hunting): picked mon.noname-c con 0x7f32d013e430 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient(hunting): picked mon.noname-a con 0x7f32d01604e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient(hunting): picked mon.noname-b con 0x7f32d0181fe0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d008ee70 con 0x7f32d01604e0 2026-02-13T08:05:50.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d008e5d0 con 0x7f32d013e430 2026-02-13T08:05:50.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d008e8b0 con 0x7f32d0181fe0 2026-02-13T08:05:50.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient(hunting): authenticate will time out at 456.438609s 2026-02-13T08:05:50.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32ce7fc640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f32d01604e0 0x7f32d01808c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42358/0 (socket says 10.20.193.104:42358) 2026-02-13T08:05:50.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cf7fe640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f32d0181fe0 0x7f32d01a23c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40782/0 (socket says 10.20.193.104:40782) 2026-02-13T08:05:50.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32ce7fc640 1 -- 10.20.193.104:0/3952695068 learned_addr learned my addr 10.20.193.104:0/3952695068 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 -- 10.20.193.104:0/3952695068 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134326186 0 0) 0x7f32d008ee70 con 0x7f32d01604e0 2026-02-13T08:05:50.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient(hunting): my global_id is 4365 2026-02-13T08:05:50.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 -- 10.20.193.104:0/3952695068 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32bc003620 con 0x7f32d01604e0 2026-02-13T08:05:50.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 -- 10.20.193.104:0/3952695068 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200967419 0 0) 0x7f32d008e8b0 con 0x7f32d0181fe0 2026-02-13T08:05:50.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient(hunting): my global_id is 4349 2026-02-13T08:05:50.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 -- 10.20.193.104:0/3952695068 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32d008ee70 con 0x7f32d0181fe0 2026-02-13T08:05:50.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 -- 10.20.193.104:0/3952695068 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 644582939 0 0) 0x7f32bc003620 con 0x7f32d01604e0 2026-02-13T08:05:50.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 -- 10.20.193.104:0/3952695068 >> v1:10.20.193.104:6790/0 conn(0x7f32d0181fe0 legacy=0x7f32d01a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 -- 10.20.193.104:0/3952695068 >> v1:10.20.193.119:6789/0 conn(0x7f32d013e430 legacy=0x7f32d013e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 monclient: found mon.noname-a 2026-02-13T08:05:50.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:50.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 -- 10.20.193.104:0/3952695068 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d013ef10 con 0x7f32d01604e0 2026-02-13T08:05:50.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 -- 10.20.193.104:0/3952695068 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f32b8002e00 con 0x7f32d01604e0 2026-02-13T08:05:50.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:50.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient: dump: 2026-02-13T08:05:50.865 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.866 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.866 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.866 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.866 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.866 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.866 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.866 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.866 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.866 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 5 monclient: authenticate success, global_id 4365 2026-02-13T08:05:50.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:50.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 -- 10.20.193.104:0/3952695068 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32b8003090 con 0x7f32d01604e0 2026-02-13T08:05:50.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 1 -- 10.20.193.104:0/3952695068 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f32b80034d0 con 0x7f32d01604e0 2026-02-13T08:05:50.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:50.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32cdffb640 10 monclient: dump: 2026-02-13T08:05:50.867 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.867 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.867 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.867 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 4 set_mon_vals no callback set 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient: shutdown 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 1 -- 10.20.193.104:0/3952695068 >> v1:10.20.193.104:6789/0 conn(0x7f32d01604e0 legacy=0x7f32d01808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 1 -- 10.20.193.104:0/3952695068 shutdown_connections 2026-02-13T08:05:50.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 1 -- 10.20.193.104:0/3952695068 >> 10.20.193.104:0/3952695068 conn(0x7f32d0090a40 msgr2=0x7f32d0085e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 1 -- 10.20.193.104:0/3952695068 shutdown_connections 2026-02-13T08:05:50.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 1 -- 10.20.193.104:0/3952695068 wait complete. 2026-02-13T08:05:50.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient: build_initial_monmap 2026-02-13T08:05:50.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.844+0000 7f32d5914640 10 monclient: monmap: 2026-02-13T08:05:50.869 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:50.869 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:50.869 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:50.869 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:50.869 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:50.869 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.870 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:50.870 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:50.870 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:50.870 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 librados: starting msgr at 2026-02-13T08:05:50.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 librados: starting objecter 2026-02-13T08:05:50.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 Processor -- start 2026-02-13T08:05:50.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 -- start start 2026-02-13T08:05:50.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 librados: setting wanted keys 2026-02-13T08:05:50.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 librados: calling monclient init 2026-02-13T08:05:50.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient: init 2026-02-13T08:05:50.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:50.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:50.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient(hunting): picked mon.noname-b con 0x7f32d013e430 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:50.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient(hunting): picked mon.noname-c con 0x7f32d01604e0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:50.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient(hunting): picked mon.noname-a con 0x7f32d0181fe0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:50.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d0164080 con 0x7f32d0181fe0 2026-02-13T08:05:50.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d0164ef0 con 0x7f32d013e430 2026-02-13T08:05:50.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d0180e90 con 0x7f32d01604e0 2026-02-13T08:05:50.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:50.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient(hunting): authenticate will time out at 456.440446s 2026-02-13T08:05:50.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32ce7fc640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f32d01604e0 0x7f32d0180780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40798/0 (socket says 10.20.193.104:40798) 2026-02-13T08:05:50.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32ce7fc640 1 -- 10.20.193.104:0/2486012608 learned_addr learned my addr 10.20.193.104:0/2486012608 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:50.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 client.?.objecter ms_handle_connect 0x7f32d01604e0 2026-02-13T08:05:50.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 client.?.objecter ms_handle_connect 0x7f32d0181fe0 2026-02-13T08:05:50.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1297163012 0 0) 0x7f32d0180e90 con 0x7f32d01604e0 2026-02-13T08:05:50.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): my global_id is 4352 2026-02-13T08:05:50.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32a0003620 con 0x7f32d01604e0 2026-02-13T08:05:50.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314454802 0 0) 0x7f32d0164080 con 0x7f32d0181fe0 2026-02-13T08:05:50.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): my global_id is 4368 2026-02-13T08:05:50.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32d0180e90 con 0x7f32d0181fe0 2026-02-13T08:05:50.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 client.?.objecter ms_handle_connect 0x7f32d013e430 2026-02-13T08:05:50.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:50.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2986073131 0 0) 0x7f32d0180e90 con 0x7f32d0181fe0 2026-02-13T08:05:50.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32d0164080 con 0x7f32d0181fe0 2026-02-13T08:05:50.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f32c0003440 con 0x7f32d0181fe0 2026-02-13T08:05:50.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:50.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): dump: 2026-02-13T08:05:50.874 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.874 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.874 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.874 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.874 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.874 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.874 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.874 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.875 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.875 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:50.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2718452202 0 0) 0x7f32d0164ef0 con 0x7f32d013e430 2026-02-13T08:05:50.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:50.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:50.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:50.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): my global_id is 4339 2026-02-13T08:05:50.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32d0180e90 con 0x7f32d013e430 2026-02-13T08:05:50.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1931948069 0 0) 0x7f32a0003620 con 0x7f32d01604e0 2026-02-13T08:05:50.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32d0164ef0 con 0x7f32d01604e0 2026-02-13T08:05:50.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f32b80033e0 con 0x7f32d01604e0 2026-02-13T08:05:50.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:50.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:50.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient(hunting): dump: 2026-02-13T08:05:50.876 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.876 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.876 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.876 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.876 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.876 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.876 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.877 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.877 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.877 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3814226589 0 0) 0x7f32d0164ef0 con 0x7f32d01604e0 2026-02-13T08:05:50.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 >> v1:10.20.193.119:6789/0 conn(0x7f32d013e430 legacy=0x7f32d0180070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 >> v1:10.20.193.104:6789/0 conn(0x7f32d0181fe0 legacy=0x7f32d012bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:50.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 monclient: found mon.c 2026-02-13T08:05:50.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:50.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d008ab30 con 0x7f32d01604e0 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient: _finish_auth 0 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 5 monclient: authenticate success, global_id 4352 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient: _renew_subs 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 -- 10.20.193.104:0/2486012608 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f32d0162b90 con 0x7f32d01604e0 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 client.4352.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient: _renew_subs 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 -- 10.20.193.104:0/2486012608 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f32d0161170 con 0x7f32d01604e0 2026-02-13T08:05:50.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 librados: init done 2026-02-13T08:05:50.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32b8004cf0 con 0x7f32d01604e0 2026-02-13T08:05:50.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:50.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f32b8002900 con 0x7f32d01604e0 2026-02-13T08:05:50.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:50.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:50.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 monclient: dump: 2026-02-13T08:05:50.879 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:50.879 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:50.879 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.880 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:50.880 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:50.880 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:50.880 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:50.880 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:50.880 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:50.880 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:50.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32cd7fa640 4 set_mon_vals no callback set 2026-02-13T08:05:50.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32d5914640 1 -- 10.20.193.104:0/2486012608 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d0061860 con 0x7f32d01604e0 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f32b8010d10 con 0x7f32d01604e0 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f32b804a170 con 0x7f32d01604e0 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 client.4352.objecter ms_dispatch2 0x7f32d0000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 3 client.4352.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 3 client.4352.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 20 client.4352.objecter dump_active .. 0 homeless 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32ceffd640 10 monclient: get_auth_request con 0x7f32a003ba40 auth_method 0 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.848+0000 7f32a7fff640 10 client.4352.objecter ms_handle_connect 0x7f32a003ba40 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.852+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f32b8016c30 con 0x7f32d01604e0 2026-02-13T08:05:50.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.852+0000 7f32a7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:50.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.852+0000 7f32a7fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:50.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 1 -- 10.20.193.104:0/2486012608 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32d008a400 con 0x7f32a003ba40 2026-02-13T08:05:50.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32a7fff640 1 -- 10.20.193.104:0/2486012608 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34187 (unknown 2965378022 0 1399472304) 0x7f32d008a400 con 0x7f32a003ba40 2026-02-13T08:05:50.942 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:50.944 INFO:teuthology.orchestra.run.trial104.stderr:dumped all 2026-02-13T08:05:50.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 10 librados: watch_flush enter 2026-02-13T08:05:50.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 10 librados: watch_flush exit 2026-02-13T08:05:50.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 20 client.4352.objecter shutdown clearing up homeless session... 2026-02-13T08:05:50.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 10 client.4352.objecter successfully canceled tick 2026-02-13T08:05:50.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 1 -- 10.20.193.104:0/2486012608 >> v1:10.20.193.119:6812/276487904 conn(0x7f32a003ba40 legacy=0x7f32a005bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 10 monclient: shutdown 2026-02-13T08:05:50.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:50.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 1 -- 10.20.193.104:0/2486012608 >> v1:10.20.193.104:6790/0 conn(0x7f32d01604e0 legacy=0x7f32d0180780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:50.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 1 -- 10.20.193.104:0/2486012608 shutdown_connections 2026-02-13T08:05:50.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 1 -- 10.20.193.104:0/2486012608 >> 10.20.193.104:0/2486012608 conn(0x7f32d0090a40 msgr2=0x7f32d0089940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:50.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 1 -- 10.20.193.104:0/2486012608 shutdown_connections 2026-02-13T08:05:50.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 1 -- 10.20.193.104:0/2486012608 wait complete. 2026-02-13T08:05:50.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:50.932+0000 7f32d5914640 1 librados: shutdown 2026-02-13T08:05:50.951 INFO:teuthology.orchestra.run.trial104.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-13T08:05:50.692381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162744,"kb_used_data":984,"kb_used_omap":43,"kb_used_meta":161620,"kb_avail":566068296,"statfs":{"total":579820584960,"available":579653935104,"internally_reserved":0,"allocated":1007616,"data_stored":1457434,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":44845,"internal_metadata":165499091},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.362883"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689616+0000","last_change":"2026-02-13T08:05:48.689722+0000","last_active":"2026-02-13T08:05:48.689616+0000","last_peered":"2026-02-13T08:05:48.689616+0000","last_clean":"2026-02-13T08:05:48.689616+0000","last_became_active":"2026-02-13T08:05:46.332518+0000","last_became_peered":"2026-02-13T08:05:46.332518+0000","last_unstale":"2026-02-13T08:05:48.689616+0000","last_undegraded":"2026-02-13T08:05:48.689616+0000","last_fullsized":"2026-02-13T08:05:48.689616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:47.031472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027820299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241193+0000","last_change":"2026-02-13T08:05:48.241308+0000","last_active":"2026-02-13T08:05:48.241193+0000","last_peered":"2026-02-13T08:05:48.241193+0000","last_clean":"2026-02-13T08:05:48.241193+0000","last_became_active":"2026-02-13T08:05:46.238040+0000","last_became_peered":"2026-02-13T08:05:46.238040+0000","last_unstale":"2026-02-13T08:05:48.241193+0000","last_undegraded":"2026-02-13T08:05:48.241193+0000","last_fullsized":"2026-02-13T08:05:48.241193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:05.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040397499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689589+0000","last_change":"2026-02-13T08:05:48.689720+0000","last_active":"2026-02-13T08:05:48.689589+0000","last_peered":"2026-02-13T08:05:48.689589+0000","last_clean":"2026-02-13T08:05:48.689589+0000","last_became_active":"2026-02-13T08:05:46.419763+0000","last_became_peered":"2026-02-13T08:05:46.419763+0000","last_unstale":"2026-02-13T08:05:48.689589+0000","last_undegraded":"2026-02-13T08:05:48.689589+0000","last_fullsized":"2026-02-13T08:05:48.689589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:11.120130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031193600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241158+0000","last_change":"2026-02-13T08:05:48.241321+0000","last_active":"2026-02-13T08:05:48.241158+0000","last_peered":"2026-02-13T08:05:48.241158+0000","last_clean":"2026-02-13T08:05:48.241158+0000","last_became_active":"2026-02-13T08:05:46.325615+0000","last_became_peered":"2026-02-13T08:05:46.325615+0000","last_unstale":"2026-02-13T08:05:48.241158+0000","last_undegraded":"2026-02-13T08:05:48.241158+0000","last_fullsized":"2026-02-13T08:05:48.241158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:50:27.013203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041541599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.335785+0000","last_change":"2026-02-13T08:05:48.335785+0000","last_active":"2026-02-13T08:05:48.335785+0000","last_peered":"2026-02-13T08:05:48.335785+0000","last_clean":"2026-02-13T08:05:48.335785+0000","last_became_active":"2026-02-13T08:05:46.332174+0000","last_became_peered":"2026-02-13T08:05:46.332174+0000","last_unstale":"2026-02-13T08:05:48.335785+0000","last_undegraded":"2026-02-13T08:05:48.335785+0000","last_fullsized":"2026-02-13T08:05:48.335785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:06.536002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000284605,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241612+0000","last_change":"2026-02-13T08:05:48.241731+0000","last_active":"2026-02-13T08:05:48.241612+0000","last_peered":"2026-02-13T08:05:48.241612+0000","last_clean":"2026-02-13T08:05:48.241612+0000","last_became_active":"2026-02-13T08:05:46.236660+0000","last_became_peered":"2026-02-13T08:05:46.236660+0000","last_unstale":"2026-02-13T08:05:48.241612+0000","last_undegraded":"2026-02-13T08:05:48.241612+0000","last_fullsized":"2026-02-13T08:05:48.241612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:54:09.509002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024995099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689748+0000","last_change":"2026-02-13T08:05:48.689871+0000","last_active":"2026-02-13T08:05:48.689748+0000","last_peered":"2026-02-13T08:05:48.689748+0000","last_clean":"2026-02-13T08:05:48.689748+0000","last_became_active":"2026-02-13T08:05:46.331895+0000","last_became_peered":"2026-02-13T08:05:46.331895+0000","last_unstale":"2026-02-13T08:05:48.689748+0000","last_undegraded":"2026-02-13T08:05:48.689748+0000","last_fullsized":"2026-02-13T08:05:48.689748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:19.373004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.335680+0000","last_change":"2026-02-13T08:05:48.335814+0000","last_active":"2026-02-13T08:05:48.335680+0000","last_peered":"2026-02-13T08:05:48.335680+0000","last_clean":"2026-02-13T08:05:48.335680+0000","last_became_active":"2026-02-13T08:05:46.331985+0000","last_became_peered":"2026-02-13T08:05:46.331985+0000","last_unstale":"2026-02-13T08:05:48.335680+0000","last_undegraded":"2026-02-13T08:05:48.335680+0000","last_fullsized":"2026-02-13T08:05:48.335680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:31:52.202154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030744700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":156,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689359+0000","last_change":"2026-02-13T08:05:43.034445+0000","last_active":"2026-02-13T08:05:48.689359+0000","last_peered":"2026-02-13T08:05:48.689359+0000","last_clean":"2026-02-13T08:05:48.689359+0000","last_became_active":"2026-02-13T08:05:43.032364+0000","last_became_peered":"2026-02-13T08:05:43.032364+0000","last_unstale":"2026-02-13T08:05:48.689359+0000","last_undegraded":"2026-02-13T08:05:48.689359+0000","last_fullsized":"2026-02-13T08:05:48.689359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_clean_scrub_stamp":"2026-02-13T08:05:41.931597+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:28.101837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":1180736,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6822,"internal_metadata":27583834},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":44720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":184,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":188416,"data_stored":631044,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":7473,"internal_metadata":27583183},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":192,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":196608,"data_stored":635088,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T08:05:50.953 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-13T08:05:50.953 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T08:05:50.953 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-13T08:05:50.953 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-13T08:05:51.013 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient: get_monmap_and_config 2026-02-13T08:05:51.013 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.013 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient: monmap: 2026-02-13T08:05:51.013 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.013 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.013 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:51.010284+0000 2026-02-13T08:05:51.013 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:51.010284+0000 2026-02-13T08:05:51.014 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.014 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.014 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.014 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:51.014 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:51.014 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 1 Processor -- start 2026-02-13T08:05:51.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 1 -- start start 2026-02-13T08:05:51.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient: init 2026-02-13T08:05:51.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:51.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient(hunting): picked mon.noname-c con 0x7f7b5408e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient(hunting): picked mon.noname-a con 0x7f7b5408ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient(hunting): picked mon.noname-b con 0x7f7b5417fe50 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b54089fa0 con 0x7f7b5408ef90 2026-02-13T08:05:51.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b54089760 con 0x7f7b5408e4b0 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b5408af90 con 0x7f7b5417fe50 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient(hunting): authenticate will time out at 456.599197s 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b596d1640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f7b5408ef90 0x7f7b5417e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42388/0 (socket says 10.20.193.104:42388) 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b596d1640 1 -- 10.20.193.104:0/751331802 learned_addr learned my addr 10.20.193.104:0/751331802 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242445800 0 0) 0x7f7b54089fa0 con 0x7f7b5408ef90 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): my global_id is 4371 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b3c003620 con 0x7f7b5408ef90 2026-02-13T08:05:51.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 219551353 0 0) 0x7f7b5408af90 con 0x7f7b5417fe50 2026-02-13T08:05:51.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): my global_id is 4355 2026-02-13T08:05:51.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b54089fa0 con 0x7f7b5417fe50 2026-02-13T08:05:51.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291836544 0 0) 0x7f7b54089760 con 0x7f7b5408e4b0 2026-02-13T08:05:51.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient(hunting): my global_id is 4342 2026-02-13T08:05:51.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b5408af90 con 0x7f7b5408e4b0 2026-02-13T08:05:51.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 80214726 0 0) 0x7f7b3c003620 con 0x7f7b5408ef90 2026-02-13T08:05:51.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 >> v1:10.20.193.104:6790/0 conn(0x7f7b5417fe50 legacy=0x7f7b541a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 >> v1:10.20.193.119:6789/0 conn(0x7f7b5408e4b0 legacy=0x7f7b5408e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 monclient: found mon.noname-a 2026-02-13T08:05:51.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5408b270 con 0x7f7b5408ef90 2026-02-13T08:05:51.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7b48002e00 con 0x7f7b5408ef90 2026-02-13T08:05:51.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:51.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient: dump: 2026-02-13T08:05:51.027 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.027 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.027 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.027 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.027 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.027 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.028 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.028 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.028 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.028 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 5 monclient: authenticate success, global_id 4371 2026-02-13T08:05:51.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:51.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b48003040 con 0x7f7b5408ef90 2026-02-13T08:05:51.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 1 -- 10.20.193.104:0/751331802 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7b48003480 con 0x7f7b5408ef90 2026-02-13T08:05:51.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:51.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b58ed0640 10 monclient: dump: 2026-02-13T08:05:51.029 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.029 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.029 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.029 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.029 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.029 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.029 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.029 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.029 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.030 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:51.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.004+0000 7f7b5c15d640 4 set_mon_vals no callback set 2026-02-13T08:05:51.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: shutdown 2026-02-13T08:05:51.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- 10.20.193.104:0/751331802 >> v1:10.20.193.104:6789/0 conn(0x7f7b5408ef90 legacy=0x7f7b5417e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- 10.20.193.104:0/751331802 shutdown_connections 2026-02-13T08:05:51.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- 10.20.193.104:0/751331802 >> 10.20.193.104:0/751331802 conn(0x7f7b54051e80 msgr2=0x7f7b5408c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- 10.20.193.104:0/751331802 shutdown_connections 2026-02-13T08:05:51.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- 10.20.193.104:0/751331802 wait complete. 2026-02-13T08:05:51.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: monmap: 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 librados: starting msgr at 2026-02-13T08:05:51.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 librados: starting objecter 2026-02-13T08:05:51.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 Processor -- start 2026-02-13T08:05:51.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- start start 2026-02-13T08:05:51.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 librados: setting wanted keys 2026-02-13T08:05:51.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 librados: calling monclient init 2026-02-13T08:05:51.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: init 2026-02-13T08:05:51.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:51.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient(hunting): picked mon.noname-b con 0x7f7b5408e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient(hunting): picked mon.noname-a con 0x7f7b5408ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient(hunting): picked mon.noname-c con 0x7f7b5417fe50 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b54080500 con 0x7f7b5408ef90 2026-02-13T08:05:51.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b54086790 con 0x7f7b5408e4b0 2026-02-13T08:05:51.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b54080220 con 0x7f7b5417fe50 2026-02-13T08:05:51.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient(hunting): authenticate will time out at 456.601135s 2026-02-13T08:05:51.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b596d1640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f7b5408ef90 0x7f7b540871b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42402/0 (socket says 10.20.193.104:42402) 2026-02-13T08:05:51.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b596d1640 1 -- 10.20.193.104:0/2177390300 learned_addr learned my addr 10.20.193.104:0/2177390300 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 client.?.objecter ms_handle_connect 0x7f7b5408ef90 2026-02-13T08:05:51.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 client.?.objecter ms_handle_connect 0x7f7b5417fe50 2026-02-13T08:05:51.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3767075869 0 0) 0x7f7b54080500 con 0x7f7b5408ef90 2026-02-13T08:05:51.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): my global_id is 4374 2026-02-13T08:05:51.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b24003620 con 0x7f7b5408ef90 2026-02-13T08:05:51.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471332892 0 0) 0x7f7b54080220 con 0x7f7b5417fe50 2026-02-13T08:05:51.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): my global_id is 4358 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b54080500 con 0x7f7b5417fe50 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 client.?.objecter ms_handle_connect 0x7f7b5408e4b0 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4143089645 0 0) 0x7f7b24003620 con 0x7f7b5408ef90 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b54080220 con 0x7f7b5408ef90 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7b48003390 con 0x7f7b5408ef90 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): dump: 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.035 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.036 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.036 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.036 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.036 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.036 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.036 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.036 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.036 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:51.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3870361561 0 0) 0x7f7b54086790 con 0x7f7b5408e4b0 2026-02-13T08:05:51.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): my global_id is 4345 2026-02-13T08:05:51.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b24003620 con 0x7f7b5408e4b0 2026-02-13T08:05:51.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2717728489 0 0) 0x7f7b54080500 con 0x7f7b5417fe50 2026-02-13T08:05:51.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7b54086790 con 0x7f7b5417fe50 2026-02-13T08:05:51.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7b50003440 con 0x7f7b5417fe50 2026-02-13T08:05:51.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:51.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient(hunting): dump: 2026-02-13T08:05:51.038 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.038 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.038 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.038 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.038 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.038 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.038 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.038 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.038 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.038 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3076834667 0 0) 0x7f7b54080220 con 0x7f7b5408ef90 2026-02-13T08:05:51.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 >> v1:10.20.193.104:6790/0 conn(0x7f7b5417fe50 legacy=0x7f7b540878c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 >> v1:10.20.193.119:6789/0 conn(0x7f7b5408e4b0 legacy=0x7f7b54086aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 monclient: found mon.a 2026-02-13T08:05:51.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5407f340 con 0x7f7b5408ef90 2026-02-13T08:05:51.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 5 monclient: authenticate success, global_id 4374 2026-02-13T08:05:51.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: _renew_subs 2026-02-13T08:05:51.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- 10.20.193.104:0/2177390300 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7b54171850 con 0x7f7b5408ef90 2026-02-13T08:05:51.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 client.4374.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:51.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: _renew_subs 2026-02-13T08:05:51.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- 10.20.193.104:0/2177390300 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7b54171db0 con 0x7f7b5408ef90 2026-02-13T08:05:51.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 librados: init done 2026-02-13T08:05:51.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7b48002f90 con 0x7f7b5408ef90 2026-02-13T08:05:51.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.040 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7b48004cf0 con 0x7f7b5408ef90 2026-02-13T08:05:51.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:51.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 monclient: dump: 2026-02-13T08:05:51.041 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.041 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.041 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.041 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.041 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.041 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.041 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.041 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.042 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.042 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b43fff640 4 set_mon_vals no callback set 2026-02-13T08:05:51.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b5c15d640 1 -- 10.20.193.104:0/2177390300 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b54061860 con 0x7f7b5408ef90 2026-02-13T08:05:51.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f7b48010d00 con 0x7f7b5408ef90 2026-02-13T08:05:51.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f7b4804a210 con 0x7f7b5408ef90 2026-02-13T08:05:51.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 client.4374.objecter ms_dispatch2 0x7f7b54000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:51.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 3 client.4374.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:51.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 3 client.4374.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:51.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 20 client.4374.objecter dump_active .. 0 homeless 2026-02-13T08:05:51.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b59ed2640 10 monclient: get_auth_request con 0x7f7b2403ba80 auth_method 0 2026-02-13T08:05:51.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.008+0000 7f7b427fc640 10 client.4374.objecter ms_handle_connect 0x7f7b2403ba80 2026-02-13T08:05:51.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.012+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f7b48016c70 con 0x7f7b5408ef90 2026-02-13T08:05:51.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.012+0000 7f7b427fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.012+0000 7f7b427fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:51.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-13T08:05:51.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-13T08:05:51.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 1 -- 10.20.193.104:0/2177390300 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7b5408cc70 con 0x7f7b5408ef90 2026-02-13T08:05:51.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b427fc640 1 -- 10.20.193.104:0/2177390300 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f7b4801bb90 con 0x7f7b5408ef90 2026-02-13T08:05:51.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b427fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-13T08:05:51.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b427fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:51.121 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:51.122 INFO:teuthology.orchestra.run.trial104.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-13T08:05:51.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 10 librados: watch_flush enter 2026-02-13T08:05:51.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 10 librados: watch_flush exit 2026-02-13T08:05:51.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 20 client.4374.objecter shutdown clearing up homeless session... 2026-02-13T08:05:51.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 10 client.4374.objecter successfully canceled tick 2026-02-13T08:05:51.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 1 -- 10.20.193.104:0/2177390300 >> v1:10.20.193.119:6812/276487904 conn(0x7f7b2403ba80 legacy=0x7f7b2405bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 10 monclient: shutdown 2026-02-13T08:05:51.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 1 -- 10.20.193.104:0/2177390300 >> v1:10.20.193.104:6789/0 conn(0x7f7b5408ef90 legacy=0x7f7b540871b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 1 -- 10.20.193.104:0/2177390300 shutdown_connections 2026-02-13T08:05:51.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 1 -- 10.20.193.104:0/2177390300 >> 10.20.193.104:0/2177390300 conn(0x7f7b54051e80 msgr2=0x7f7b5405d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 1 -- 10.20.193.104:0/2177390300 shutdown_connections 2026-02-13T08:05:51.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 1 -- 10.20.193.104:0/2177390300 wait complete. 2026-02-13T08:05:51.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.112+0000 7f7b5c15d640 1 librados: shutdown 2026-02-13T08:05:51.131 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-13T08:05:51.131 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-13T08:05:51.155 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-13T08:05:51.155 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T08:05:51.225 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 10 monclient: get_monmap_and_config 2026-02-13T08:05:51.226 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.226 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 10 monclient: monmap: 2026-02-13T08:05:51.226 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.226 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.226 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:51.223118+0000 2026-02-13T08:05:51.226 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:51.223118+0000 2026-02-13T08:05:51.226 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.226 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.226 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.226 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:51.227 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:51.227 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 1 Processor -- start 2026-02-13T08:05:51.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 1 -- start start 2026-02-13T08:05:51.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 10 monclient: init 2026-02-13T08:05:51.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:51.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 10 monclient(hunting): picked mon.noname-c con 0x7f4bfc08e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 10 monclient(hunting): picked mon.noname-a con 0x7f4bfc08ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 10 monclient(hunting): picked mon.noname-b con 0x7f4bfc17fe50 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc089fa0 con 0x7f4bfc08ef90 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc089760 con 0x7f4bfc08e4b0 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc08af90 con 0x7f4bfc17fe50 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4c00e99640 10 monclient(hunting): authenticate will time out at 456.811808s 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4bf9d74640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f4bfc08ef90 0x7f4bfc17e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42414/0 (socket says 10.20.193.104:42414) 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4bfad76640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f4bfc17fe50 0x7f4bfc1a0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40822/0 (socket says 10.20.193.104:40822) 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.216+0000 7f4bf9d74640 1 -- 10.20.193.104:0/1179768084 learned_addr learned my addr 10.20.193.104:0/1179768084 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900933031 0 0) 0x7f4bfc089fa0 con 0x7f4bfc08ef90 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): my global_id is 4377 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be8003620 con 0x7f4bfc08ef90 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015357205 0 0) 0x7f4bfc08af90 con 0x7f4bfc17fe50 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): my global_id is 4361 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bfc089fa0 con 0x7f4bfc17fe50 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1256468638 0 0) 0x7f4bfc089760 con 0x7f4bfc08e4b0 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient(hunting): my global_id is 4348 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bfc08af90 con 0x7f4bfc08e4b0 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2511536364 0 0) 0x7f4be8003620 con 0x7f4bfc08ef90 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 >> v1:10.20.193.104:6790/0 conn(0x7f4bfc17fe50 legacy=0x7f4bfc1a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 >> v1:10.20.193.119:6789/0 conn(0x7f4bfc08e4b0 legacy=0x7f4bfc08e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 monclient: found mon.noname-a 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc08b270 con 0x7f4bfc08ef90 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4be4002d30 con 0x7f4bfc08ef90 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient: dump: 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.238 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 5 monclient: authenticate success, global_id 4377 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4be4002f40 con 0x7f4bfc08ef90 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 1 -- 10.20.193.104:0/1179768084 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4be4003380 con 0x7f4bfc08ef90 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf9573640 10 monclient: dump: 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.239 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 4 set_mon_vals no callback set 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: shutdown 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- 10.20.193.104:0/1179768084 >> v1:10.20.193.104:6789/0 conn(0x7f4bfc08ef90 legacy=0x7f4bfc17e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- 10.20.193.104:0/1179768084 shutdown_connections 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- 10.20.193.104:0/1179768084 >> 10.20.193.104:0/1179768084 conn(0x7f4bfc051e80 msgr2=0x7f4bfc08c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- 10.20.193.104:0/1179768084 shutdown_connections 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- 10.20.193.104:0/1179768084 wait complete. 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: monmap: 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.241 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 librados: starting msgr at 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 librados: starting objecter 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 Processor -- start 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- start start 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 librados: setting wanted keys 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 librados: calling monclient init 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: init 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient(hunting): picked mon.noname-a con 0x7f4bfc08e4b0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient(hunting): picked mon.noname-c con 0x7f4bfc08ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient(hunting): picked mon.noname-b con 0x7f4bfc17fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc07f8c0 con 0x7f4bfc08e4b0 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc07fba0 con 0x7f4bfc17fe50 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc086790 con 0x7f4bfc08ef90 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient(hunting): authenticate will time out at 456.814243s 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bfa575640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f4bfc08e4b0 0x7f4bfc07bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42416/0 (socket says 10.20.193.104:42416) 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bfa575640 1 -- 10.20.193.104:0/84371180 learned_addr learned my addr 10.20.193.104:0/84371180 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 client.?.objecter ms_handle_connect 0x7f4bfc08e4b0 2026-02-13T08:05:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 client.?.objecter ms_handle_connect 0x7f4bfc08ef90 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286873330 0 0) 0x7f4bfc07f8c0 con 0x7f4bfc08e4b0 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): my global_id is 4380 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bc8003620 con 0x7f4bfc08e4b0 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 784492217 0 0) 0x7f4bfc086790 con 0x7f4bfc08ef90 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): my global_id is 4364 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bfc07f8c0 con 0x7f4bfc08ef90 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3258879393 0 0) 0x7f4bfc07f8c0 con 0x7f4bfc08ef90 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4bfc086790 con 0x7f4bfc08ef90 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4be4002c40 con 0x7f4bfc08ef90 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): dump: 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.245 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 780179442 0 0) 0x7f4bc8003620 con 0x7f4bfc08e4b0 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4bfc07f8c0 con 0x7f4bfc08e4b0 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 client.?.objecter ms_handle_connect 0x7f4bfc17fe50 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4bf0003100 con 0x7f4bfc08e4b0 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient(hunting): dump: 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1584173462 0 0) 0x7f4bfc086790 con 0x7f4bfc08ef90 2026-02-13T08:05:51.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 >> v1:10.20.193.119:6789/0 conn(0x7f4bfc17fe50 legacy=0x7f4bfc170840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 >> v1:10.20.193.104:6789/0 conn(0x7f4bfc08e4b0 legacy=0x7f4bfc07bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 monclient: found mon.c 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc07ed80 con 0x7f4bfc08ef90 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 5 monclient: authenticate success, global_id 4364 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: _renew_subs 2026-02-13T08:05:51.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- 10.20.193.104:0/84371180 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc07f300 con 0x7f4bfc08ef90 2026-02-13T08:05:51.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 client.4364.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:51.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: _renew_subs 2026-02-13T08:05:51.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- 10.20.193.104:0/84371180 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4bfc07e680 con 0x7f4bfc08ef90 2026-02-13T08:05:51.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 librados: init done 2026-02-13T08:05:51.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4be4002e50 con 0x7f4bfc08ef90 2026-02-13T08:05:51.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4be4004b90 con 0x7f4bfc08ef90 2026-02-13T08:05:51.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:51.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 monclient: dump: 2026-02-13T08:05:51.250 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.250 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.250 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.250 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.250 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.250 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.250 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.250 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.250 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.251 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bf8d72640 4 set_mon_vals no callback set 2026-02-13T08:05:51.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4c00e99640 1 -- 10.20.193.104:0/84371180 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc061860 con 0x7f4bfc08ef90 2026-02-13T08:05:51.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f4be4010ba0 con 0x7f4bfc08ef90 2026-02-13T08:05:51.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f4be404a1c0 con 0x7f4bfc08ef90 2026-02-13T08:05:51.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 client.4364.objecter ms_dispatch2 0x7f4bfc000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:51.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 3 client.4364.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:51.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 3 client.4364.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:51.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 20 client.4364.objecter dump_active .. 0 homeless 2026-02-13T08:05:51.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4bfa575640 10 monclient: get_auth_request con 0x7f4bc803b7f0 auth_method 0 2026-02-13T08:05:51.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.220+0000 7f4be2ffd640 10 client.4364.objecter ms_handle_connect 0x7f4bc803b7f0 2026-02-13T08:05:51.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.224+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f4be4016c80 con 0x7f4bfc08ef90 2026-02-13T08:05:51.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.224+0000 7f4be2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.224+0000 7f4be2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:51.320 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:51.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:51.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 1 -- 10.20.193.104:0/84371180 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bfc08cc70 con 0x7f4bfc08ef90 2026-02-13T08:05:51.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4be2ffd640 1 -- 10.20.193.104:0/84371180 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+10844 (unknown 941590788 0 3560767378) 0x7f4be4016580 con 0x7f4bfc08ef90 2026-02-13T08:05:51.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4be2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:05:51.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4be2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:51.322 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:51.322 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":19,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","created":"2026-02-13T08:05:35.908543+0000","modified":"2026-02-13T08:05:50.596670+0000","last_up_change":"2026-02-13T08:05:40.923658+0000","last_in_change":"2026-02-13T08:05:36.956118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T08:05:41.903600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T08:05:44.705774+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"460b851b-aaa4-48d1-a60f-7c4d57195f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6808","nonce":1354850314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6809","nonce":1354850314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6811","nonce":1354850314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6810","nonce":1354850314}]},"public_addr":"10.20.193.104:6808/1354850314","cluster_addr":"10.20.193.104:6809/1354850314","heartbeat_back_addr":"10.20.193.104:6811/1354850314","heartbeat_front_addr":"10.20.193.104:6810/1354850314","state":["exists","up"]},{"osd":1,"uuid":"b96ae2ae-1756-45e7-932c-2e09b469bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6804","nonce":3474406264}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6805","nonce":3474406264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6807","nonce":3474406264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6806","nonce":3474406264}]},"public_addr":"10.20.193.104:6804/3474406264","cluster_addr":"10.20.193.104:6805/3474406264","heartbeat_back_addr":"10.20.193.104:6807/3474406264","heartbeat_front_addr":"10.20.193.104:6806/3474406264","state":["exists","up"]},{"osd":2,"uuid":"1ae934c3-1aba-4596-abae-1b7697ebf029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6800","nonce":3938786817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6801","nonce":3938786817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6803","nonce":3938786817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6802","nonce":3938786817}]},"public_addr":"10.20.193.104:6800/3938786817","cluster_addr":"10.20.193.104:6801/3938786817","heartbeat_back_addr":"10.20.193.104:6803/3938786817","heartbeat_front_addr":"10.20.193.104:6802/3938786817","state":["exists","up"]},{"osd":3,"uuid":"029c49a7-88e6-439c-90f8-534c1b8e4056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6800","nonce":4283496532}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6801","nonce":4283496532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6803","nonce":4283496532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6802","nonce":4283496532}]},"public_addr":"10.20.193.119:6800/4283496532","cluster_addr":"10.20.193.119:6801/4283496532","heartbeat_back_addr":"10.20.193.119:6803/4283496532","heartbeat_front_addr":"10.20.193.119:6802/4283496532","state":["exists","up"]},{"osd":4,"uuid":"a8122973-739c-4b4b-a9f5-59eac5f15f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6808","nonce":1543069880}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6809","nonce":1543069880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6811","nonce":1543069880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6810","nonce":1543069880}]},"public_addr":"10.20.193.119:6808/1543069880","cluster_addr":"10.20.193.119:6809/1543069880","heartbeat_back_addr":"10.20.193.119:6811/1543069880","heartbeat_front_addr":"10.20.193.119:6810/1543069880","state":["exists","up"]},{"osd":5,"uuid":"8901cba8-49ff-4a2a-8f16-6b3db8eff80e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6804","nonce":527707922}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6805","nonce":527707922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6807","nonce":527707922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6806","nonce":527707922}]},"public_addr":"10.20.193.119:6804/527707922","cluster_addr":"10.20.193.119:6805/527707922","heartbeat_back_addr":"10.20.193.119:6807/527707922","heartbeat_front_addr":"10.20.193.119:6806/527707922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T08:05:51.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 10 librados: watch_flush enter 2026-02-13T08:05:51.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 10 librados: watch_flush exit 2026-02-13T08:05:51.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 20 client.4364.objecter shutdown clearing up homeless session... 2026-02-13T08:05:51.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 10 client.4364.objecter successfully canceled tick 2026-02-13T08:05:51.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 1 -- 10.20.193.104:0/84371180 >> v1:10.20.193.119:6812/276487904 conn(0x7f4bc803b7f0 legacy=0x7f4bc805bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 10 monclient: shutdown 2026-02-13T08:05:51.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 1 -- 10.20.193.104:0/84371180 >> v1:10.20.193.104:6790/0 conn(0x7f4bfc08ef90 legacy=0x7f4bfc07c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 1 -- 10.20.193.104:0/84371180 shutdown_connections 2026-02-13T08:05:51.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 1 -- 10.20.193.104:0/84371180 >> 10.20.193.104:0/84371180 conn(0x7f4bfc051e80 msgr2=0x7f4bfc05cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 1 -- 10.20.193.104:0/84371180 shutdown_connections 2026-02-13T08:05:51.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 1 -- 10.20.193.104:0/84371180 wait complete. 2026-02-13T08:05:51.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.312+0000 7f4c00e99640 1 librados: shutdown 2026-02-13T08:05:51.332 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T08:05:41.903600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2026-02-13T08:05:44.705774+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 18, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T08:05:51.333 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-13T08:05:51.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient: get_monmap_and_config 2026-02-13T08:05:51.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient: monmap: 2026-02-13T08:05:51.397 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.397 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.397 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:51.393894+0000 2026-02-13T08:05:51.397 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:51.393894+0000 2026-02-13T08:05:51.397 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.397 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.397 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.397 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:51.397 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:51.398 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 1 Processor -- start 2026-02-13T08:05:51.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 1 -- start start 2026-02-13T08:05:51.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient: init 2026-02-13T08:05:51.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:51.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient(hunting): picked mon.noname-a con 0x7fa8f413f690 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient(hunting): picked mon.noname-b con 0x7fa8f408d940 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient(hunting): picked mon.noname-c con 0x7fa8f408dd60 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f408b890 con 0x7fa8f413f690 2026-02-13T08:05:51.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f408bb70 con 0x7fa8f408dd60 2026-02-13T08:05:51.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f4089f10 con 0x7fa8f408d940 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient(hunting): authenticate will time out at 456.982621s 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8f8852640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fa8f413f690 0x7fa8f408d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42426/0 (socket says 10.20.193.104:42426) 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8f8852640 1 -- 10.20.193.104:0/1370236236 learned_addr learned my addr 10.20.193.104:0/1370236236 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3846443331 0 0) 0x7fa8f4089f10 con 0x7fa8f408d940 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): my global_id is 4367 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8e0003620 con 0x7fa8f408d940 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415465330 0 0) 0x7fa8f408b890 con 0x7fa8f413f690 2026-02-13T08:05:51.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): my global_id is 4383 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8f4089f10 con 0x7fa8f413f690 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1182371208 0 0) 0x7fa8f408bb70 con 0x7fa8f408dd60 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient(hunting): my global_id is 4351 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8f408b890 con 0x7fa8f408dd60 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 555406740 0 0) 0x7fa8e0003620 con 0x7fa8f408d940 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 >> v1:10.20.193.119:6789/0 conn(0x7fa8f408dd60 legacy=0x7fa8f41a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.408 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 >> v1:10.20.193.104:6789/0 conn(0x7fa8f413f690 legacy=0x7fa8f408d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 monclient: found mon.noname-b 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f41a63c0 con 0x7fa8f408d940 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 5 monclient: authenticate success, global_id 4367 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa8dc002e00 con 0x7fa8f408d940 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient: dump: 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8dc003040 con 0x7fa8f408d940 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 1 -- 10.20.193.104:0/1370236236 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa8dc003480 con 0x7fa8f408d940 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8eb7fe640 10 monclient: dump: 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.411 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 4 set_mon_vals no callback set 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 10 monclient: shutdown 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 1 -- 10.20.193.104:0/1370236236 >> v1:10.20.193.104:6790/0 conn(0x7fa8f408d940 legacy=0x7fa8f4180540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 1 -- 10.20.193.104:0/1370236236 shutdown_connections 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 1 -- 10.20.193.104:0/1370236236 >> 10.20.193.104:0/1370236236 conn(0x7fa8f4051a50 msgr2=0x7fa8f4051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 1 -- 10.20.193.104:0/1370236236 shutdown_connections 2026-02-13T08:05:51.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.388+0000 7fa8faadd640 1 -- 10.20.193.104:0/1370236236 wait complete. 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient: monmap: 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 librados: starting msgr at 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 librados: starting objecter 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 Processor -- start 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 -- start start 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 librados: setting wanted keys 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 librados: calling monclient init 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient: init 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient(hunting): picked mon.noname-a con 0x7fa8f408d940 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient(hunting): picked mon.noname-b con 0x7fa8f408dd60 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient(hunting): picked mon.noname-c con 0x7fa8f413f690 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f410a730 con 0x7fa8f408d940 2026-02-13T08:05:51.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f410aa10 con 0x7fa8f408dd60 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f4109210 con 0x7fa8f413f690 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient(hunting): authenticate will time out at 456.984851s 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8f8852640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fa8f408d940 0x7fa8f4129b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42432/0 (socket says 10.20.193.104:42432) 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8f8852640 1 -- 10.20.193.104:0/2688670487 learned_addr learned my addr 10.20.193.104:0/2688670487 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 client.?.objecter ms_handle_connect 0x7fa8f408d940 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 client.?.objecter ms_handle_connect 0x7fa8f413f690 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3710620583 0 0) 0x7fa8f410a730 con 0x7fa8f408d940 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): my global_id is 4386 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c4003620 con 0x7fa8f408d940 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3621485779 0 0) 0x7fa8f4109210 con 0x7fa8f413f690 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): my global_id is 4370 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8f410a730 con 0x7fa8f413f690 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 595137781 0 0) 0x7fa8c4003620 con 0x7fa8f408d940 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8f4109210 con 0x7fa8f408d940 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa8e4003100 con 0x7fa8f408d940 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): dump: 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:51.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 client.?.objecter ms_handle_connect 0x7fa8f408dd60 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 135327516 0 0) 0x7fa8f410a730 con 0x7fa8f413f690 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8c4003620 con 0x7fa8f413f690 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa8f0003420 con 0x7fa8f413f690 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient(hunting): dump: 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.418 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1848281631 0 0) 0x7fa8f4109210 con 0x7fa8f408d940 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 >> v1:10.20.193.104:6790/0 conn(0x7fa8f413f690 legacy=0x7fa8f41a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 >> v1:10.20.193.119:6789/0 conn(0x7fa8f408dd60 legacy=0x7fa8f41a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 monclient: found mon.a 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f41098f0 con 0x7fa8f408d940 2026-02-13T08:05:51.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 5 monclient: authenticate success, global_id 4386 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient: _renew_subs 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 -- 10.20.193.104:0/2688670487 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f41086b0 con 0x7fa8f408d940 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 client.4386.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient: _renew_subs 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 -- 10.20.193.104:0/2688670487 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa8f412a240 con 0x7fa8f408d940 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 librados: init done 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8e4003490 con 0x7fa8f408d940 2026-02-13T08:05:51.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa8e4004d30 con 0x7fa8f408d940 2026-02-13T08:05:51.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:51.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8eaffd640 4 set_mon_vals no callback set 2026-02-13T08:05:51.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 monclient: dump: 2026-02-13T08:05:51.421 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.421 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.421 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.421 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.421 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.421 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.422 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.422 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.422 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.422 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8faadd640 1 -- 10.20.193.104:0/2688670487 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8f410a2c0 con 0x7fa8f408d940 2026-02-13T08:05:51.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fa8e4010d40 con 0x7fa8f408d940 2026-02-13T08:05:51.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7fa8e404a130 con 0x7fa8f408d940 2026-02-13T08:05:51.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 client.4386.objecter ms_dispatch2 0x7fa8f4000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:51.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 3 client.4386.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:51.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 3 client.4386.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:51.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 20 client.4386.objecter dump_active .. 0 homeless 2026-02-13T08:05:51.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8ebfff640 10 monclient: get_auth_request con 0x7fa8c403b840 auth_method 0 2026-02-13T08:05:51.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.392+0000 7fa8e97fa640 10 client.4386.objecter ms_handle_connect 0x7fa8c403b840 2026-02-13T08:05:51.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.396+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7fa8e4016b90 con 0x7fa8f408d940 2026-02-13T08:05:51.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.396+0000 7fa8e97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.396+0000 7fa8e97fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:51.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.476+0000 7fa8faadd640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-13T08:05:51.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.476+0000 7fa8faadd640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-13T08:05:51.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.476+0000 7fa8faadd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.476+0000 7fa8faadd640 1 -- 10.20.193.104:0/2688670487 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa8f40380f0 con 0x7fa8f408d940 2026-02-13T08:05:51.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.476+0000 7fa8e97fa640 1 -- 10.20.193.104:0/2688670487 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) ==== 93+0+10 (unknown 4170632370 0 2170607528) 0x7fa8e4016490 con 0x7fa8f408d940 2026-02-13T08:05:51.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.476+0000 7fa8e97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-13T08:05:51.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.476+0000 7fa8e97fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:51.487 INFO:teuthology.orchestra.run.trial104.stdout:pg_num: 1 2026-02-13T08:05:51.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 10 librados: watch_flush enter 2026-02-13T08:05:51.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 10 librados: watch_flush exit 2026-02-13T08:05:51.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 20 client.4386.objecter shutdown clearing up homeless session... 2026-02-13T08:05:51.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 10 client.4386.objecter successfully canceled tick 2026-02-13T08:05:51.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 1 -- 10.20.193.104:0/2688670487 >> v1:10.20.193.119:6812/276487904 conn(0x7fa8c403b840 legacy=0x7fa8c405bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 10 monclient: shutdown 2026-02-13T08:05:51.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 1 -- 10.20.193.104:0/2688670487 >> v1:10.20.193.104:6789/0 conn(0x7fa8f408d940 legacy=0x7fa8f4129b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 1 -- 10.20.193.104:0/2688670487 shutdown_connections 2026-02-13T08:05:51.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 1 -- 10.20.193.104:0/2688670487 >> 10.20.193.104:0/2688670487 conn(0x7fa8f4051a50 msgr2=0x7fa8f405ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 1 -- 10.20.193.104:0/2688670487 shutdown_connections 2026-02-13T08:05:51.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 1 -- 10.20.193.104:0/2688670487 wait complete. 2026-02-13T08:05:51.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.480+0000 7fa8faadd640 1 librados: shutdown 2026-02-13T08:05:51.497 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-13T08:05:51.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 10 monclient: get_monmap_and_config 2026-02-13T08:05:51.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 10 monclient: monmap: 2026-02-13T08:05:51.569 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.570 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.570 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:51.566644+0000 2026-02-13T08:05:51.570 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:51.566644+0000 2026-02-13T08:05:51.570 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.570 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.570 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.570 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:51.570 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:51.570 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 1 Processor -- start 2026-02-13T08:05:51.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 1 -- start start 2026-02-13T08:05:51.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 10 monclient: init 2026-02-13T08:05:51.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:51.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 10 monclient(hunting): picked mon.noname-b con 0x7fa7ac139f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 10 monclient(hunting): picked mon.noname-a con 0x7fa7ac15e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 10 monclient(hunting): picked mon.noname-c con 0x7fa7ac17fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7ac13aa00 con 0x7fa7ac15e200 2026-02-13T08:05:51.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7ac08ba20 con 0x7fa7ac17fd00 2026-02-13T08:05:51.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7ac089e30 con 0x7fa7ac139f20 2026-02-13T08:05:51.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7b0a5a640 10 monclient(hunting): authenticate will time out at 457.155724s 2026-02-13T08:05:51.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7aa575640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fa7ac139f20 0x7fa7ac13a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40870/0 (socket says 10.20.193.104:40870) 2026-02-13T08:05:51.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9d74640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fa7ac15e200 0x7fa7ac17e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42444/0 (socket says 10.20.193.104:42444) 2026-02-13T08:05:51.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7aa575640 1 -- 10.20.193.104:0/3788468554 learned_addr learned my addr 10.20.193.104:0/3788468554 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 1 -- 10.20.193.104:0/3788468554 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695497874 0 0) 0x7fa794002920 con 0x7fa7ac15e200 2026-02-13T08:05:51.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 10 monclient(hunting): my global_id is 4389 2026-02-13T08:05:51.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 1 -- 10.20.193.104:0/3788468554 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa798003620 con 0x7fa7ac15e200 2026-02-13T08:05:51.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 1 -- 10.20.193.104:0/3788468554 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3707130756 0 0) 0x7fa7ac089e30 con 0x7fa7ac139f20 2026-02-13T08:05:51.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 10 monclient(hunting): my global_id is 4373 2026-02-13T08:05:51.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.560+0000 7fa7a9573640 1 -- 10.20.193.104:0/3788468554 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa794002920 con 0x7fa7ac139f20 2026-02-13T08:05:51.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 1 -- 10.20.193.104:0/3788468554 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1421300072 0 0) 0x7fa798003620 con 0x7fa7ac15e200 2026-02-13T08:05:51.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 1 -- 10.20.193.104:0/3788468554 >> v1:10.20.193.104:6790/0 conn(0x7fa7ac139f20 legacy=0x7fa7ac13a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 1 -- 10.20.193.104:0/3788468554 >> v1:10.20.193.119:6789/0 conn(0x7fa7ac17fd00 legacy=0x7fa7ac1a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 1 monclient: found mon.noname-a 2026-02-13T08:05:51.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 1 -- 10.20.193.104:0/3788468554 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac08a380 con 0x7fa7ac15e200 2026-02-13T08:05:51.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 1 -- 10.20.193.104:0/3788468554 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa794002fd0 con 0x7fa7ac15e200 2026-02-13T08:05:51.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:51.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 10 monclient: dump: 2026-02-13T08:05:51.583 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.583 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.583 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.583 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.583 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.583 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.583 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.583 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.584 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.584 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 5 monclient: authenticate success, global_id 4389 2026-02-13T08:05:51.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:51.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 1 -- 10.20.193.104:0/3788468554 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa7940031e0 con 0x7fa7ac15e200 2026-02-13T08:05:51.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 1 -- 10.20.193.104:0/3788468554 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa7940048e0 con 0x7fa7ac15e200 2026-02-13T08:05:51.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:51.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9573640 10 monclient: dump: 2026-02-13T08:05:51.584 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 4 set_mon_vals no callback set 2026-02-13T08:05:51.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: shutdown 2026-02-13T08:05:51.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/3788468554 >> v1:10.20.193.104:6789/0 conn(0x7fa7ac15e200 legacy=0x7fa7ac17e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/3788468554 shutdown_connections 2026-02-13T08:05:51.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/3788468554 >> 10.20.193.104:0/3788468554 conn(0x7fa7ac051a50 msgr2=0x7fa7ac051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/3788468554 shutdown_connections 2026-02-13T08:05:51.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/3788468554 wait complete. 2026-02-13T08:05:51.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: monmap: 2026-02-13T08:05:51.586 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.586 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:51.586 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:51.587 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:51.587 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.587 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.587 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.587 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:51.587 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:51.587 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 librados: starting msgr at 2026-02-13T08:05:51.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 librados: starting objecter 2026-02-13T08:05:51.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 Processor -- start 2026-02-13T08:05:51.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- start start 2026-02-13T08:05:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 librados: setting wanted keys 2026-02-13T08:05:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 librados: calling monclient init 2026-02-13T08:05:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: init 2026-02-13T08:05:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient(hunting): picked mon.noname-b con 0x7fa7ac139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient(hunting): picked mon.noname-a con 0x7fa7ac15e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient(hunting): picked mon.noname-c con 0x7fa7ac17fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7ac158480 con 0x7fa7ac15e200 2026-02-13T08:05:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7ac087750 con 0x7fa7ac139f20 2026-02-13T08:05:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7ac088770 con 0x7fa7ac17fd00 2026-02-13T08:05:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient(hunting): authenticate will time out at 457.157784s 2026-02-13T08:05:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9d74640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fa7ac15e200 0x7fa7ac087040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42454/0 (socket says 10.20.193.104:42454) 2026-02-13T08:05:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a9d74640 1 -- 10.20.193.104:0/175415881 learned_addr learned my addr 10.20.193.104:0/175415881 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 client.?.objecter ms_handle_connect 0x7fa7ac17fd00 2026-02-13T08:05:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 client.?.objecter ms_handle_connect 0x7fa7ac15e200 2026-02-13T08:05:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2908626094 0 0) 0x7fa7ac088770 con 0x7fa7ac17fd00 2026-02-13T08:05:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): my global_id is 4376 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa778003620 con 0x7fa7ac17fd00 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3875080396 0 0) 0x7fa7ac158480 con 0x7fa7ac15e200 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): my global_id is 4392 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7ac088770 con 0x7fa7ac15e200 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 client.?.objecter ms_handle_connect 0x7fa7ac139f20 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3927865977 0 0) 0x7fa778003620 con 0x7fa7ac17fd00 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7ac158480 con 0x7fa7ac17fd00 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa79c0033a0 con 0x7fa7ac17fd00 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): dump: 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.591 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1470159670 0 0) 0x7fa7ac088770 con 0x7fa7ac15e200 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa778003620 con 0x7fa7ac15e200 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa794002d40 con 0x7fa7ac15e200 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): dump: 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.592 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.593 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.593 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.593 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.593 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.593 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.593 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.593 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.593 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 580558156 0 0) 0x7fa7ac087750 con 0x7fa7ac139f20 2026-02-13T08:05:51.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient(hunting): my global_id is 4360 2026-02-13T08:05:51.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7ac088770 con 0x7fa7ac139f20 2026-02-13T08:05:51.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2578575365 0 0) 0x7fa7ac158480 con 0x7fa7ac17fd00 2026-02-13T08:05:51.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 >> v1:10.20.193.119:6789/0 conn(0x7fa7ac139f20 legacy=0x7fa7ac086930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 >> v1:10.20.193.104:6789/0 conn(0x7fa7ac15e200 legacy=0x7fa7ac087040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 monclient: found mon.c 2026-02-13T08:05:51.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac05c960 con 0x7fa7ac17fd00 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 5 monclient: authenticate success, global_id 4376 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: _renew_subs 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/175415881 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac15df70 con 0x7fa7ac17fd00 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 client.4376.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: _renew_subs 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/175415881 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa7ac157ab0 con 0x7fa7ac17fd00 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 librados: init done 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa79c003a00 con 0x7fa7ac17fd00 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fa79c003d90 con 0x7fa7ac17fd00 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 monclient: dump: 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.596 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.597 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.597 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.597 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.597 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.597 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7a8d72640 4 set_mon_vals no callback set 2026-02-13T08:05:51.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/175415881 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ac157fc0 con 0x7fa7ac17fd00 2026-02-13T08:05:51.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fa79c003f30 con 0x7fa7ac17fd00 2026-02-13T08:05:51.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7fa79c049300 con 0x7fa7ac17fd00 2026-02-13T08:05:51.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 client.4376.objecter ms_dispatch2 0x7fa7ac000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:51.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 3 client.4376.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:51.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 3 client.4376.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:51.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 20 client.4376.objecter dump_active .. 0 homeless 2026-02-13T08:05:51.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa7aa575640 10 monclient: get_auth_request con 0x7fa77803baa0 auth_method 0 2026-02-13T08:05:51.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.564+0000 7fa792ffd640 10 client.4376.objecter ms_handle_connect 0x7fa77803baa0 2026-02-13T08:05:51.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.568+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7fa79c015d60 con 0x7fa7ac17fd00 2026-02-13T08:05:51.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.568+0000 7fa792ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.568+0000 7fa792ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:51.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-13T08:05:51.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-13T08:05:51.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/175415881 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7fa7ac05c400 con 0x7fa7ac17fd00 2026-02-13T08:05:51.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa792ffd640 1 -- 10.20.193.104:0/175415881 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) ==== 92+0+10 (unknown 1398289234 0 265718887) 0x7fa79c015660 con 0x7fa7ac17fd00 2026-02-13T08:05:51.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa792ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-13T08:05:51.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa792ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:51.660 INFO:teuthology.orchestra.run.trial104.stdout:pg_num: 8 2026-02-13T08:05:51.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 10 librados: watch_flush enter 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 10 librados: watch_flush exit 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 20 client.4376.objecter shutdown clearing up homeless session... 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 10 client.4376.objecter successfully canceled tick 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/175415881 >> v1:10.20.193.119:6812/276487904 conn(0x7fa77803baa0 legacy=0x7fa77805bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 10 monclient: shutdown 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/175415881 >> v1:10.20.193.104:6790/0 conn(0x7fa7ac17fd00 legacy=0x7fa7ac127ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/175415881 shutdown_connections 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/175415881 >> 10.20.193.104:0/175415881 conn(0x7fa7ac051a50 msgr2=0x7fa7ac156770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/175415881 shutdown_connections 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 1 -- 10.20.193.104:0/175415881 wait complete. 2026-02-13T08:05:51.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.652+0000 7fa7b0a5a640 1 librados: shutdown 2026-02-13T08:05:51.671 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-13T08:05:51.671 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T08:05:51.740 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient: get_monmap_and_config 2026-02-13T08:05:51.740 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.740 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient: monmap: 2026-02-13T08:05:51.741 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.741 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.741 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:51.737845+0000 2026-02-13T08:05:51.741 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:51.737845+0000 2026-02-13T08:05:51.741 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.741 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.741 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.741 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:51.742 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:51.742 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.751 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 1 Processor -- start 2026-02-13T08:05:51.751 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 1 -- start start 2026-02-13T08:05:51.751 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient: init 2026-02-13T08:05:51.752 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.752 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:51.752 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient(hunting): picked mon.noname-a con 0x7f5eb013c0c0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.752 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient(hunting): picked mon.noname-c con 0x7f5eb013cba0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.752 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient(hunting): picked mon.noname-b con 0x7f5eb0181f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.752 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb008ee60 con 0x7f5eb013c0c0 2026-02-13T08:05:51.752 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb00870f0 con 0x7f5eb013cba0 2026-02-13T08:05:51.752 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb0087330 con 0x7f5eb0181f20 2026-02-13T08:05:51.752 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.752 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient(hunting): authenticate will time out at 457.326851s 2026-02-13T08:05:51.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eaeffd640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f5eb013c0c0 0x7f5eb013c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42468/0 (socket says 10.20.193.104:42468) 2026-02-13T08:05:51.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eaeffd640 1 -- 10.20.193.104:0/2339397909 learned_addr learned my addr 10.20.193.104:0/2339397909 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 -- 10.20.193.104:0/2339397909 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3651827523 0 0) 0x7f5eb0087330 con 0x7f5eb0181f20 2026-02-13T08:05:51.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient(hunting): my global_id is 4379 2026-02-13T08:05:51.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 -- 10.20.193.104:0/2339397909 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e9c003620 con 0x7f5eb0181f20 2026-02-13T08:05:51.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 -- 10.20.193.104:0/2339397909 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797320217 0 0) 0x7f5eb008ee60 con 0x7f5eb013c0c0 2026-02-13T08:05:51.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient(hunting): my global_id is 4395 2026-02-13T08:05:51.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 -- 10.20.193.104:0/2339397909 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eb0087330 con 0x7f5eb013c0c0 2026-02-13T08:05:51.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 -- 10.20.193.104:0/2339397909 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 272688573 0 0) 0x7f5e9c003620 con 0x7f5eb0181f20 2026-02-13T08:05:51.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 -- 10.20.193.104:0/2339397909 >> v1:10.20.193.119:6789/0 conn(0x7f5eb013cba0 legacy=0x7f5eb0180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 -- 10.20.193.104:0/2339397909 >> v1:10.20.193.104:6789/0 conn(0x7f5eb013c0c0 legacy=0x7f5eb013c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 monclient: found mon.noname-b 2026-02-13T08:05:51.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:51.755 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 -- 10.20.193.104:0/2339397909 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb0140150 con 0x7f5eb0181f20 2026-02-13T08:05:51.755 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.755 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.755 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.755 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 -- 10.20.193.104:0/2339397909 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5ea00030b0 con 0x7f5eb0181f20 2026-02-13T08:05:51.755 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.755 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:51.755 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient: dump: 2026-02-13T08:05:51.755 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.755 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 5 monclient: authenticate success, global_id 4379 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 -- 10.20.193.104:0/2339397909 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ea00032f0 con 0x7f5eb0181f20 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.756 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 1 -- 10.20.193.104:0/2339397909 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5ea0003700 con 0x7f5eb0181f20 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eadffb640 10 monclient: dump: 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.757 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 4 set_mon_vals no callback set 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 10 monclient: shutdown 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 1 -- 10.20.193.104:0/2339397909 >> v1:10.20.193.104:6790/0 conn(0x7f5eb0181f20 legacy=0x7f5eb01a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 1 -- 10.20.193.104:0/2339397909 shutdown_connections 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 1 -- 10.20.193.104:0/2339397909 >> 10.20.193.104:0/2339397909 conn(0x7f5eb0090810 msgr2=0x7f5eb0090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 1 -- 10.20.193.104:0/2339397909 shutdown_connections 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.732+0000 7f5eb583c640 1 -- 10.20.193.104:0/2339397909 wait complete. 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient: monmap: 2026-02-13T08:05:51.758 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.759 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:51.759 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:51.759 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:51.759 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.759 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.759 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.759 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:51.759 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:51.759 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 librados: starting msgr at 2026-02-13T08:05:51.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 librados: starting objecter 2026-02-13T08:05:51.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 Processor -- start 2026-02-13T08:05:51.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 -- start start 2026-02-13T08:05:51.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 librados: setting wanted keys 2026-02-13T08:05:51.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 librados: calling monclient init 2026-02-13T08:05:51.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient: init 2026-02-13T08:05:51.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:51.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient(hunting): picked mon.noname-b con 0x7f5eb013c0c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient(hunting): picked mon.noname-a con 0x7f5eb013cba0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient(hunting): picked mon.noname-c con 0x7f5eb0181f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb0087ba0 con 0x7f5eb013cba0 2026-02-13T08:05:51.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb00894a0 con 0x7f5eb013c0c0 2026-02-13T08:05:51.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eb008d000 con 0x7f5eb0181f20 2026-02-13T08:05:51.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient(hunting): authenticate will time out at 457.329207s 2026-02-13T08:05:51.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eae7fc640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f5eb013cba0 0x7f5eb008c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42482/0 (socket says 10.20.193.104:42482) 2026-02-13T08:05:51.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eae7fc640 1 -- 10.20.193.104:0/698567057 learned_addr learned my addr 10.20.193.104:0/698567057 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 client.?.objecter ms_handle_connect 0x7f5eb013cba0 2026-02-13T08:05:51.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 client.?.objecter ms_handle_connect 0x7f5eb0181f20 2026-02-13T08:05:51.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346224912 0 0) 0x7f5eb0087ba0 con 0x7f5eb013cba0 2026-02-13T08:05:51.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): my global_id is 4398 2026-02-13T08:05:51.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e80003620 con 0x7f5eb013cba0 2026-02-13T08:05:51.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 client.?.objecter ms_handle_connect 0x7f5eb013c0c0 2026-02-13T08:05:51.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 300753871 0 0) 0x7f5eb008d000 con 0x7f5eb0181f20 2026-02-13T08:05:51.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): my global_id is 4382 2026-02-13T08:05:51.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eb0087ba0 con 0x7f5eb0181f20 2026-02-13T08:05:51.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3689457768 0 0) 0x7f5e80003620 con 0x7f5eb013cba0 2026-02-13T08:05:51.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5eb008d000 con 0x7f5eb013cba0 2026-02-13T08:05:51.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5e980031a0 con 0x7f5eb013cba0 2026-02-13T08:05:51.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:51.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): dump: 2026-02-13T08:05:51.763 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.763 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.763 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.764 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.764 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.764 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.764 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.764 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.764 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.764 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.764 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:51.764 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2630088210 0 0) 0x7f5eb00894a0 con 0x7f5eb013c0c0 2026-02-13T08:05:51.764 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.764 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): my global_id is 4366 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e80003620 con 0x7f5eb013c0c0 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1159307876 0 0) 0x7f5eb0087ba0 con 0x7f5eb0181f20 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5eb00894a0 con 0x7f5eb0181f20 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5ea0002fc0 con 0x7f5eb0181f20 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient(hunting): dump: 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.765 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2802223989 0 0) 0x7f5eb008d000 con 0x7f5eb013cba0 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 >> v1:10.20.193.104:6790/0 conn(0x7f5eb0181f20 legacy=0x7f5eb0181810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 >> v1:10.20.193.119:6789/0 conn(0x7f5eb013c0c0 legacy=0x7f5eb008c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.766 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 monclient: found mon.a 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eb00889f0 con 0x7f5eb013cba0 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 5 monclient: authenticate success, global_id 4398 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient: _renew_subs 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 -- 10.20.193.104:0/698567057 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5eb0089780 con 0x7f5eb013cba0 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 client.4398.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:51.767 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient: _renew_subs 2026-02-13T08:05:51.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 -- 10.20.193.104:0/698567057 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5eb00891c0 con 0x7f5eb013cba0 2026-02-13T08:05:51.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 librados: init done 2026-02-13T08:05:51.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5e980039c0 con 0x7f5eb013cba0 2026-02-13T08:05:51.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5e98003d90 con 0x7f5eb013cba0 2026-02-13T08:05:51.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:51.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 monclient: dump: 2026-02-13T08:05:51.768 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.768 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5ead7fa640 4 set_mon_vals no callback set 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eb583c640 1 -- 10.20.193.104:0/698567057 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eb0087fb0 con 0x7f5eb013cba0 2026-02-13T08:05:51.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f5e98003f30 con 0x7f5eb013cba0 2026-02-13T08:05:51.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f5e9804a340 con 0x7f5eb013cba0 2026-02-13T08:05:51.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 client.4398.objecter ms_dispatch2 0x7f5eb0000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:51.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 3 client.4398.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:51.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 3 client.4398.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:51.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 20 client.4398.objecter dump_active .. 0 homeless 2026-02-13T08:05:51.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5eaeffd640 10 monclient: get_auth_request con 0x7f5e8003ba40 auth_method 0 2026-02-13T08:05:51.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.736+0000 7f5e87fff640 10 client.4398.objecter ms_handle_connect 0x7f5e8003ba40 2026-02-13T08:05:51.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.740+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f5e98016da0 con 0x7f5eb013cba0 2026-02-13T08:05:51.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.740+0000 7f5e87fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.740+0000 7f5e87fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:51.832 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 1 -- 10.20.193.104:0/698567057 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5eb0060360 con 0x7f5e8003ba40 2026-02-13T08:05:51.833 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5e87fff640 1 -- 10.20.193.104:0/698567057 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34187 (unknown 2965378022 0 1399472304) 0x7f5eb0060360 con 0x7f5e8003ba40 2026-02-13T08:05:51.833 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:51.835 INFO:teuthology.orchestra.run.trial104.stderr:dumped all 2026-02-13T08:05:51.835 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 10 librados: watch_flush enter 2026-02-13T08:05:51.835 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 10 librados: watch_flush exit 2026-02-13T08:05:51.835 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 20 client.4398.objecter shutdown clearing up homeless session... 2026-02-13T08:05:51.835 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 10 client.4398.objecter successfully canceled tick 2026-02-13T08:05:51.835 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 1 -- 10.20.193.104:0/698567057 >> v1:10.20.193.119:6812/276487904 conn(0x7f5e8003ba40 legacy=0x7f5e8005bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.835 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 10 monclient: shutdown 2026-02-13T08:05:51.835 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 1 -- 10.20.193.104:0/698567057 >> v1:10.20.193.104:6789/0 conn(0x7f5eb013cba0 legacy=0x7f5eb008c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 1 -- 10.20.193.104:0/698567057 shutdown_connections 2026-02-13T08:05:51.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 1 -- 10.20.193.104:0/698567057 >> 10.20.193.104:0/698567057 conn(0x7f5eb0090810 msgr2=0x7f5eb008f190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 1 -- 10.20.193.104:0/698567057 shutdown_connections 2026-02-13T08:05:51.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 1 -- 10.20.193.104:0/698567057 wait complete. 2026-02-13T08:05:51.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.824+0000 7f5eb583c640 1 librados: shutdown 2026-02-13T08:05:51.843 INFO:teuthology.orchestra.run.trial104.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-13T08:05:50.692381+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162744,"kb_used_data":984,"kb_used_omap":43,"kb_used_meta":161620,"kb_avail":566068296,"statfs":{"total":579820584960,"available":579653935104,"internally_reserved":0,"allocated":1007616,"data_stored":1457434,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":44845,"internal_metadata":165499091},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.362883"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689616+0000","last_change":"2026-02-13T08:05:48.689722+0000","last_active":"2026-02-13T08:05:48.689616+0000","last_peered":"2026-02-13T08:05:48.689616+0000","last_clean":"2026-02-13T08:05:48.689616+0000","last_became_active":"2026-02-13T08:05:46.332518+0000","last_became_peered":"2026-02-13T08:05:46.332518+0000","last_unstale":"2026-02-13T08:05:48.689616+0000","last_undegraded":"2026-02-13T08:05:48.689616+0000","last_fullsized":"2026-02-13T08:05:48.689616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:47.031472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027820299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241193+0000","last_change":"2026-02-13T08:05:48.241308+0000","last_active":"2026-02-13T08:05:48.241193+0000","last_peered":"2026-02-13T08:05:48.241193+0000","last_clean":"2026-02-13T08:05:48.241193+0000","last_became_active":"2026-02-13T08:05:46.238040+0000","last_became_peered":"2026-02-13T08:05:46.238040+0000","last_unstale":"2026-02-13T08:05:48.241193+0000","last_undegraded":"2026-02-13T08:05:48.241193+0000","last_fullsized":"2026-02-13T08:05:48.241193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:05.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040397499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689589+0000","last_change":"2026-02-13T08:05:48.689720+0000","last_active":"2026-02-13T08:05:48.689589+0000","last_peered":"2026-02-13T08:05:48.689589+0000","last_clean":"2026-02-13T08:05:48.689589+0000","last_became_active":"2026-02-13T08:05:46.419763+0000","last_became_peered":"2026-02-13T08:05:46.419763+0000","last_unstale":"2026-02-13T08:05:48.689589+0000","last_undegraded":"2026-02-13T08:05:48.689589+0000","last_fullsized":"2026-02-13T08:05:48.689589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:11.120130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031193600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241158+0000","last_change":"2026-02-13T08:05:48.241321+0000","last_active":"2026-02-13T08:05:48.241158+0000","last_peered":"2026-02-13T08:05:48.241158+0000","last_clean":"2026-02-13T08:05:48.241158+0000","last_became_active":"2026-02-13T08:05:46.325615+0000","last_became_peered":"2026-02-13T08:05:46.325615+0000","last_unstale":"2026-02-13T08:05:48.241158+0000","last_undegraded":"2026-02-13T08:05:48.241158+0000","last_fullsized":"2026-02-13T08:05:48.241158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:50:27.013203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041541599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.335785+0000","last_change":"2026-02-13T08:05:48.335785+0000","last_active":"2026-02-13T08:05:48.335785+0000","last_peered":"2026-02-13T08:05:48.335785+0000","last_clean":"2026-02-13T08:05:48.335785+0000","last_became_active":"2026-02-13T08:05:46.332174+0000","last_became_peered":"2026-02-13T08:05:46.332174+0000","last_unstale":"2026-02-13T08:05:48.335785+0000","last_undegraded":"2026-02-13T08:05:48.335785+0000","last_fullsized":"2026-02-13T08:05:48.335785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:06.536002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000284605,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241612+0000","last_change":"2026-02-13T08:05:48.241731+0000","last_active":"2026-02-13T08:05:48.241612+0000","last_peered":"2026-02-13T08:05:48.241612+0000","last_clean":"2026-02-13T08:05:48.241612+0000","last_became_active":"2026-02-13T08:05:46.236660+0000","last_became_peered":"2026-02-13T08:05:46.236660+0000","last_unstale":"2026-02-13T08:05:48.241612+0000","last_undegraded":"2026-02-13T08:05:48.241612+0000","last_fullsized":"2026-02-13T08:05:48.241612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:54:09.509002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024995099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689748+0000","last_change":"2026-02-13T08:05:48.689871+0000","last_active":"2026-02-13T08:05:48.689748+0000","last_peered":"2026-02-13T08:05:48.689748+0000","last_clean":"2026-02-13T08:05:48.689748+0000","last_became_active":"2026-02-13T08:05:46.331895+0000","last_became_peered":"2026-02-13T08:05:46.331895+0000","last_unstale":"2026-02-13T08:05:48.689748+0000","last_undegraded":"2026-02-13T08:05:48.689748+0000","last_fullsized":"2026-02-13T08:05:48.689748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:19.373004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.335680+0000","last_change":"2026-02-13T08:05:48.335814+0000","last_active":"2026-02-13T08:05:48.335680+0000","last_peered":"2026-02-13T08:05:48.335680+0000","last_clean":"2026-02-13T08:05:48.335680+0000","last_became_active":"2026-02-13T08:05:46.331985+0000","last_became_peered":"2026-02-13T08:05:46.331985+0000","last_unstale":"2026-02-13T08:05:48.335680+0000","last_undegraded":"2026-02-13T08:05:48.335680+0000","last_fullsized":"2026-02-13T08:05:48.335680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:31:52.202154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030744700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":156,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689359+0000","last_change":"2026-02-13T08:05:43.034445+0000","last_active":"2026-02-13T08:05:48.689359+0000","last_peered":"2026-02-13T08:05:48.689359+0000","last_clean":"2026-02-13T08:05:48.689359+0000","last_became_active":"2026-02-13T08:05:43.032364+0000","last_became_peered":"2026-02-13T08:05:43.032364+0000","last_unstale":"2026-02-13T08:05:48.689359+0000","last_undegraded":"2026-02-13T08:05:48.689359+0000","last_fullsized":"2026-02-13T08:05:48.689359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_clean_scrub_stamp":"2026-02-13T08:05:41.931597+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:28.101837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":1180736,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6822,"internal_metadata":27583834},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":44720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":184,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":188416,"data_stored":631044,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":7473,"internal_metadata":27583183},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":192,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":196608,"data_stored":635088,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T08:05:51.845 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T08:05:51.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.896+0000 7f7c04083640 10 monclient: get_monmap_and_config 2026-02-13T08:05:51.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.896+0000 7f7c04083640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.896+0000 7f7c04083640 10 monclient: monmap: 2026-02-13T08:05:51.906 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.906 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.906 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:51.903164+0000 2026-02-13T08:05:51.906 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:51.903164+0000 2026-02-13T08:05:51.906 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.906 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.906 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.907 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:51.907 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:51.907 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.896+0000 7f7c04083640 1 Processor -- start 2026-02-13T08:05:51.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.896+0000 7f7c04083640 1 -- start start 2026-02-13T08:05:51.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.896+0000 7f7c04083640 10 monclient: init 2026-02-13T08:05:51.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:05:51.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient(hunting): picked mon.noname-b con 0x7f7bfc08fa20 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient(hunting): picked mon.noname-a con 0x7f7bfc13fdc0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient(hunting): picked mon.noname-c con 0x7f7bfc181ca0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc092d80 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc08e8c0 con 0x7f7bfc181ca0 2026-02-13T08:05:51.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc0872c0 con 0x7f7bfc08fa20 2026-02-13T08:05:51.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient(hunting): authenticate will time out at 457.492198s 2026-02-13T08:05:51.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c01df8640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f7bfc08fa20 0x7f7bfc13f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40894/0 (socket says 10.20.193.104:40894) 2026-02-13T08:05:51.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c015f7640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f7bfc13fdc0 0x7f7bfc180580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42486/0 (socket says 10.20.193.104:42486) 2026-02-13T08:05:51.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c01df8640 1 -- 10.20.193.104:0/2434069325 learned_addr learned my addr 10.20.193.104:0/2434069325 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 -- 10.20.193.104:0/2434069325 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179376878 0 0) 0x7f7bf0002920 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient(hunting): my global_id is 4401 2026-02-13T08:05:51.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 -- 10.20.193.104:0/2434069325 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7be4003620 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 -- 10.20.193.104:0/2434069325 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 119626530 0 0) 0x7f7bfc0872c0 con 0x7f7bfc08fa20 2026-02-13T08:05:51.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient(hunting): my global_id is 4385 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 -- 10.20.193.104:0/2434069325 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bf0002920 con 0x7f7bfc08fa20 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 -- 10.20.193.104:0/2434069325 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 328712940 0 0) 0x7f7be4003620 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 -- 10.20.193.104:0/2434069325 >> v1:10.20.193.104:6790/0 conn(0x7f7bfc08fa20 legacy=0x7f7bfc13f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 -- 10.20.193.104:0/2434069325 >> v1:10.20.193.119:6789/0 conn(0x7f7bfc181ca0 legacy=0x7f7bfc1a2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 monclient: found mon.noname-a 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 -- 10.20.193.104:0/2434069325 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc08fdf0 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 -- 10.20.193.104:0/2434069325 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7bf0002fd0 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient: dump: 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.918 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 5 monclient: authenticate success, global_id 4401 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 -- 10.20.193.104:0/2434069325 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bf00031e0 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 1 -- 10.20.193.104:0/2434069325 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7bf00048e0 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c00df6640 10 monclient: dump: 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.919 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 4 set_mon_vals no callback set 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: shutdown 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- 10.20.193.104:0/2434069325 >> v1:10.20.193.104:6789/0 conn(0x7f7bfc13fdc0 legacy=0x7f7bfc180580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- 10.20.193.104:0/2434069325 shutdown_connections 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- 10.20.193.104:0/2434069325 >> 10.20.193.104:0/2434069325 conn(0x7f7bfc0909b0 msgr2=0x7f7bfc090db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- 10.20.193.104:0/2434069325 shutdown_connections 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- 10.20.193.104:0/2434069325 wait complete. 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: build_initial_monmap 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: monmap: 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:51.921 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 librados: starting msgr at 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 librados: starting objecter 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 Processor -- start 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- start start 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 librados: setting wanted keys 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 librados: calling monclient init 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: init 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:51.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient(hunting): picked mon.noname-b con 0x7f7bfc08fa20 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient(hunting): picked mon.noname-c con 0x7f7bfc13fdc0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient(hunting): picked mon.noname-a con 0x7f7bfc181ca0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc10e4c0 con 0x7f7bfc181ca0 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc12d9e0 con 0x7f7bfc08fa20 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bfc129f70 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient(hunting): authenticate will time out at 457.494286s 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c015f7640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f7bfc13fdc0 0x7f7bfc12d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40906/0 (socket says 10.20.193.104:40906) 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c015f7640 1 -- 10.20.193.104:0/2159549990 learned_addr learned my addr 10.20.193.104:0/2159549990 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 client.?.objecter ms_handle_connect 0x7f7bfc181ca0 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 client.?.objecter ms_handle_connect 0x7f7bfc13fdc0 2026-02-13T08:05:51.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555129140 0 0) 0x7f7bfc10e4c0 con 0x7f7bfc181ca0 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): my global_id is 4404 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bcc003620 con 0x7f7bfc181ca0 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1218086060 0 0) 0x7f7bfc129f70 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): my global_id is 4388 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bfc10e4c0 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4142406864 0 0) 0x7f7bcc003620 con 0x7f7bfc181ca0 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bfc129f70 con 0x7f7bfc181ca0 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7bf8003370 con 0x7f7bfc181ca0 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): dump: 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.925 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3214329611 0 0) 0x7f7bfc10e4c0 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7bcc003620 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7bf0002d40 con 0x7f7bfc13fdc0 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient(hunting): dump: 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.926 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2302384937 0 0) 0x7f7bfc129f70 con 0x7f7bfc181ca0 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 >> v1:10.20.193.104:6790/0 conn(0x7f7bfc13fdc0 legacy=0x7f7bfc12d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 >> v1:10.20.193.119:6789/0 conn(0x7f7bfc08fa20 legacy=0x7f7bfc12cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient: _finish_hunting 0 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 monclient: found mon.a 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:51.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc181a90 con 0x7f7bfc181ca0 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient: _finish_auth 0 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient: _check_auth_tickets 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 client.?.objecter ms_handle_connect 0x7f7bfc08fa20 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 5 monclient: authenticate success, global_id 4404 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: _renew_subs 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- 10.20.193.104:0/2159549990 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7bfc10d650 con 0x7f7bfc181ca0 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 client.4404.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: _renew_subs 2026-02-13T08:05:51.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- 10.20.193.104:0/2159549990 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7bfc129b00 con 0x7f7bfc181ca0 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 librados: init done 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7bf80039d0 con 0x7f7bfc181ca0 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7bf8003de0 con 0x7f7bfc181ca0 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bebfff640 4 set_mon_vals no callback set 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 monclient: dump: 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:51.929 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c04083640 1 -- 10.20.193.104:0/2159549990 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bfc061860 con 0x7f7bfc181ca0 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f7bf8003f80 con 0x7f7bfc181ca0 2026-02-13T08:05:51.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f7bf80492e0 con 0x7f7bfc181ca0 2026-02-13T08:05:51.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 client.4404.objecter ms_dispatch2 0x7f7bfc000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:51.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 3 client.4404.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:51.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 3 client.4404.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:51.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 20 client.4404.objecter dump_active .. 0 homeless 2026-02-13T08:05:51.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7c01df8640 10 monclient: get_auth_request con 0x7f7bcc03b850 auth_method 0 2026-02-13T08:05:51.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.900+0000 7f7bea7fc640 10 client.4404.objecter ms_handle_connect 0x7f7bcc03b850 2026-02-13T08:05:51.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.904+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f7bfc08e8c0 con 0x7f7bfc181ca0 2026-02-13T08:05:51.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.904+0000 7f7bea7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:51.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.904+0000 7f7bea7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:51.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.984+0000 7f7c04083640 1 -- 10.20.193.104:0/2159549990 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7bfc10c1c0 con 0x7f7bcc03b850 2026-02-13T08:05:51.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.984+0000 7f7bea7fc640 1 -- 10.20.193.104:0/2159549990 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34187 (unknown 2965378022 0 764702462) 0x7f7bec0079f0 con 0x7f7bcc03b850 2026-02-13T08:05:51.995 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:05:51.996 INFO:teuthology.orchestra.run.trial104.stderr:dumped all 2026-02-13T08:05:51.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 10 librados: watch_flush enter 2026-02-13T08:05:51.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 10 librados: watch_flush exit 2026-02-13T08:05:51.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 20 client.4404.objecter shutdown clearing up homeless session... 2026-02-13T08:05:51.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 10 client.4404.objecter successfully canceled tick 2026-02-13T08:05:51.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 1 -- 10.20.193.104:0/2159549990 >> v1:10.20.193.119:6812/276487904 conn(0x7f7bcc03b850 legacy=0x7f7bcc05bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 10 monclient: shutdown 2026-02-13T08:05:51.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:51.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 1 -- 10.20.193.104:0/2159549990 >> v1:10.20.193.104:6789/0 conn(0x7f7bfc181ca0 legacy=0x7f7bfc181380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:51.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 1 -- 10.20.193.104:0/2159549990 shutdown_connections 2026-02-13T08:05:51.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 1 -- 10.20.193.104:0/2159549990 >> 10.20.193.104:0/2159549990 conn(0x7f7bfc0909b0 msgr2=0x7f7bfc088c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:51.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 1 -- 10.20.193.104:0/2159549990 shutdown_connections 2026-02-13T08:05:51.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 1 -- 10.20.193.104:0/2159549990 wait complete. 2026-02-13T08:05:51.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:51.988+0000 7f7c04083640 1 librados: shutdown 2026-02-13T08:05:52.004 INFO:teuthology.orchestra.run.trial104.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2026-02-13T08:05:51.959035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":162744,"kb_used_data":984,"kb_used_omap":43,"kb_used_meta":161620,"kb_avail":566068296,"statfs":{"total":579820584960,"available":579653935104,"internally_reserved":0,"allocated":1007616,"data_stored":1457434,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":44845,"internal_metadata":165499091},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.629537"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689616+0000","last_change":"2026-02-13T08:05:48.689722+0000","last_active":"2026-02-13T08:05:48.689616+0000","last_peered":"2026-02-13T08:05:48.689616+0000","last_clean":"2026-02-13T08:05:48.689616+0000","last_became_active":"2026-02-13T08:05:46.332518+0000","last_became_peered":"2026-02-13T08:05:46.332518+0000","last_unstale":"2026-02-13T08:05:48.689616+0000","last_undegraded":"2026-02-13T08:05:48.689616+0000","last_fullsized":"2026-02-13T08:05:48.689616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:47.031472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027820299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241193+0000","last_change":"2026-02-13T08:05:48.241308+0000","last_active":"2026-02-13T08:05:48.241193+0000","last_peered":"2026-02-13T08:05:48.241193+0000","last_clean":"2026-02-13T08:05:48.241193+0000","last_became_active":"2026-02-13T08:05:46.238040+0000","last_became_peered":"2026-02-13T08:05:46.238040+0000","last_unstale":"2026-02-13T08:05:48.241193+0000","last_undegraded":"2026-02-13T08:05:48.241193+0000","last_fullsized":"2026-02-13T08:05:48.241193+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:05.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040397499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689589+0000","last_change":"2026-02-13T08:05:48.689720+0000","last_active":"2026-02-13T08:05:48.689589+0000","last_peered":"2026-02-13T08:05:48.689589+0000","last_clean":"2026-02-13T08:05:48.689589+0000","last_became_active":"2026-02-13T08:05:46.419763+0000","last_became_peered":"2026-02-13T08:05:46.419763+0000","last_unstale":"2026-02-13T08:05:48.689589+0000","last_undegraded":"2026-02-13T08:05:48.689589+0000","last_fullsized":"2026-02-13T08:05:48.689589+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:11.120130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031193600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241158+0000","last_change":"2026-02-13T08:05:48.241321+0000","last_active":"2026-02-13T08:05:48.241158+0000","last_peered":"2026-02-13T08:05:48.241158+0000","last_clean":"2026-02-13T08:05:48.241158+0000","last_became_active":"2026-02-13T08:05:46.325615+0000","last_became_peered":"2026-02-13T08:05:46.325615+0000","last_unstale":"2026-02-13T08:05:48.241158+0000","last_undegraded":"2026-02-13T08:05:48.241158+0000","last_fullsized":"2026-02-13T08:05:48.241158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:50:27.013203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041541599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.335785+0000","last_change":"2026-02-13T08:05:48.335785+0000","last_active":"2026-02-13T08:05:48.335785+0000","last_peered":"2026-02-13T08:05:48.335785+0000","last_clean":"2026-02-13T08:05:48.335785+0000","last_became_active":"2026-02-13T08:05:46.332174+0000","last_became_peered":"2026-02-13T08:05:46.332174+0000","last_unstale":"2026-02-13T08:05:48.335785+0000","last_undegraded":"2026-02-13T08:05:48.335785+0000","last_fullsized":"2026-02-13T08:05:48.335785+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:06.536002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000284605,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.241612+0000","last_change":"2026-02-13T08:05:48.241731+0000","last_active":"2026-02-13T08:05:48.241612+0000","last_peered":"2026-02-13T08:05:48.241612+0000","last_clean":"2026-02-13T08:05:48.241612+0000","last_became_active":"2026-02-13T08:05:46.236660+0000","last_became_peered":"2026-02-13T08:05:46.236660+0000","last_unstale":"2026-02-13T08:05:48.241612+0000","last_undegraded":"2026-02-13T08:05:48.241612+0000","last_fullsized":"2026-02-13T08:05:48.241612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:54:09.509002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024995099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689748+0000","last_change":"2026-02-13T08:05:48.689871+0000","last_active":"2026-02-13T08:05:48.689748+0000","last_peered":"2026-02-13T08:05:48.689748+0000","last_clean":"2026-02-13T08:05:48.689748+0000","last_became_active":"2026-02-13T08:05:46.331895+0000","last_became_peered":"2026-02-13T08:05:46.331895+0000","last_unstale":"2026-02-13T08:05:48.689748+0000","last_undegraded":"2026-02-13T08:05:48.689748+0000","last_fullsized":"2026-02-13T08:05:48.689748+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:19.373004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.335680+0000","last_change":"2026-02-13T08:05:48.335814+0000","last_active":"2026-02-13T08:05:48.335680+0000","last_peered":"2026-02-13T08:05:48.335680+0000","last_clean":"2026-02-13T08:05:48.335680+0000","last_became_active":"2026-02-13T08:05:46.331985+0000","last_became_peered":"2026-02-13T08:05:46.331985+0000","last_unstale":"2026-02-13T08:05:48.335680+0000","last_undegraded":"2026-02-13T08:05:48.335680+0000","last_fullsized":"2026-02-13T08:05:48.335680+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:31:52.202154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030744700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":156,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-13T08:05:48.689359+0000","last_change":"2026-02-13T08:05:43.034445+0000","last_active":"2026-02-13T08:05:48.689359+0000","last_peered":"2026-02-13T08:05:48.689359+0000","last_clean":"2026-02-13T08:05:48.689359+0000","last_became_active":"2026-02-13T08:05:43.032364+0000","last_became_peered":"2026-02-13T08:05:43.032364+0000","last_unstale":"2026-02-13T08:05:48.689359+0000","last_undegraded":"2026-02-13T08:05:48.689359+0000","last_fullsized":"2026-02-13T08:05:48.689359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_clean_scrub_stamp":"2026-02-13T08:05:41.931597+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:28.101837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":1180736,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6822,"internal_metadata":27583834},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27104,"kb_used_data":144,"kb_used_omap":6,"kb_used_meta":26937,"kb_avail":94344736,"statfs":{"total":96636764160,"available":96609009664,"internally_reserved":0,"allocated":147456,"data_stored":44720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6825,"internal_metadata":27583831},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27144,"kb_used_data":184,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344696,"statfs":{"total":96636764160,"available":96608968704,"internally_reserved":0,"allocated":188416,"data_stored":631044,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":7473,"internal_metadata":27583183},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":48848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":48867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27152,"kb_used_data":192,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344688,"statfs":{"total":96636764160,"available":96608960512,"internally_reserved":0,"allocated":196608,"data_stored":635088,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":7475,"internal_metadata":27583181},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T08:05:52.006 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-13T08:05:52.006 DEBUG:tasks.mon_thrash:Yielding 2026-02-13T08:05:52.006 INFO:teuthology.run_tasks:Running task workunit... 2026-02-13T08:05:52.032 INFO:tasks.workunit:Pulling workunits from ref 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T08:05:52.033 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-13T08:05:52.033 DEBUG:teuthology.orchestra.run.trial119:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-13T08:05:52.034 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-13T08:05:52.034 INFO:tasks.mon_thrash.mon_thrasher:seed: 1770969952, revive delay: 90.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-13T08:05:52.034 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T08:05:52.034 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:05:52.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T08:05:52.040 INFO:teuthology.orchestra.run.trial119.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-13T08:05:52.040 DEBUG:teuthology.orchestra.run.trial119:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-13T08:05:52.084 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-13T08:05:52.085 DEBUG:teuthology.orchestra.run.trial119:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-13T08:05:52.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 10 monclient: get_monmap_and_config 2026-02-13T08:05:52.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 10 monclient: build_initial_monmap 2026-02-13T08:05:52.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 10 monclient: monmap: 2026-02-13T08:05:52.093 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:52.094 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.094 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:52.090716+0000 2026-02-13T08:05:52.094 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:52.090716+0000 2026-02-13T08:05:52.094 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:52.094 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.094 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:52.094 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:52.094 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:52.094 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 1 Processor -- start 2026-02-13T08:05:52.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 1 -- start start 2026-02-13T08:05:52.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 10 monclient: init 2026-02-13T08:05:52.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:52.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:05:52.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 10 monclient(hunting): picked mon.noname-c con 0x7f141408e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:52.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 10 monclient(hunting): picked mon.noname-b con 0x7f141408ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:52.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 10 monclient(hunting): picked mon.noname-a con 0x7f141417fe50 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:52.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1414089fa0 con 0x7f141417fe50 2026-02-13T08:05:52.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1414089760 con 0x7f141408e4b0 2026-02-13T08:05:52.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141408af90 con 0x7f141408ef90 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14197b4640 10 monclient(hunting): authenticate will time out at 457.679817s 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14127fc640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f141408ef90 0x7f141417e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40916/0 (socket says 10.20.193.104:40916) 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.084+0000 7f14127fc640 1 -- 10.20.193.104:0/3701985197 learned_addr learned my addr 10.20.193.104:0/3701985197 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682418189 0 0) 0x7f141408af90 con 0x7f141408ef90 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): my global_id is 4391 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1400003620 con 0x7f141408ef90 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859752149 0 0) 0x7f1414089fa0 con 0x7f141417fe50 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): my global_id is 4407 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f141408af90 con 0x7f141417fe50 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3521232762 0 0) 0x7f1414089760 con 0x7f141408e4b0 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient(hunting): my global_id is 4372 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1414089fa0 con 0x7f141408e4b0 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3633098784 0 0) 0x7f1400003620 con 0x7f141408ef90 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 >> v1:10.20.193.119:6789/0 conn(0x7f141408e4b0 legacy=0x7f141408e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 >> v1:10.20.193.104:6789/0 conn(0x7f141417fe50 legacy=0x7f14141a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 monclient: found mon.noname-b 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141408b270 con 0x7f141408ef90 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f13fc002e00 con 0x7f141408ef90 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient: dump: 2026-02-13T08:05:52.106 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 5 monclient: authenticate success, global_id 4391 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:52.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13fc0030c0 con 0x7f141408ef90 2026-02-13T08:05:52.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:52.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 1 -- 10.20.193.104:0/3701985197 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f13fc0034d0 con 0x7f141408ef90 2026-02-13T08:05:52.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:52.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1411ffb640 10 monclient: dump: 2026-02-13T08:05:52.108 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.108 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.108 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.108 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.108 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.108 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.109 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.109 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.109 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.109 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:52.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 4 set_mon_vals no callback set 2026-02-13T08:05:52.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: shutdown 2026-02-13T08:05:52.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:52.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- 10.20.193.104:0/3701985197 >> v1:10.20.193.104:6790/0 conn(0x7f141408ef90 legacy=0x7f141417e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- 10.20.193.104:0/3701985197 shutdown_connections 2026-02-13T08:05:52.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- 10.20.193.104:0/3701985197 >> 10.20.193.104:0/3701985197 conn(0x7f1414051e80 msgr2=0x7f141408c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:52.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- 10.20.193.104:0/3701985197 shutdown_connections 2026-02-13T08:05:52.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- 10.20.193.104:0/3701985197 wait complete. 2026-02-13T08:05:52.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: build_initial_monmap 2026-02-13T08:05:52.110 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: monmap: 2026-02-13T08:05:52.110 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:52.110 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:52.110 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:52.110 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:52.110 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:52.110 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.111 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:52.111 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:52.111 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:52.111 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 librados: starting msgr at 2026-02-13T08:05:52.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 librados: starting objecter 2026-02-13T08:05:52.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 Processor -- start 2026-02-13T08:05:52.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- start start 2026-02-13T08:05:52.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 librados: setting wanted keys 2026-02-13T08:05:52.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 librados: calling monclient init 2026-02-13T08:05:52.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: init 2026-02-13T08:05:52.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:52.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:52.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient(hunting): picked mon.noname-a con 0x7f141408e4b0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:52.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient(hunting): picked mon.noname-b con 0x7f141408ef90 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:52.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient(hunting): picked mon.noname-c con 0x7f141417fe50 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:52.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14140884c0 con 0x7f141408e4b0 2026-02-13T08:05:52.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14140878f0 con 0x7f141408ef90 2026-02-13T08:05:52.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141405c930 con 0x7f141417fe50 2026-02-13T08:05:52.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:52.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient(hunting): authenticate will time out at 457.681671s 2026-02-13T08:05:52.112 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1412ffd640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f141408e4b0 0x7f1414086ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42508/0 (socket says 10.20.193.104:42508) 2026-02-13T08:05:52.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f1412ffd640 1 -- 10.20.193.104:0/1016113435 learned_addr learned my addr 10.20.193.104:0/1016113435 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:52.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 client.?.objecter ms_handle_connect 0x7f141408e4b0 2026-02-13T08:05:52.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 client.?.objecter ms_handle_connect 0x7f141417fe50 2026-02-13T08:05:52.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 431780159 0 0) 0x7f14140884c0 con 0x7f141408e4b0 2026-02-13T08:05:52.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): my global_id is 4410 2026-02-13T08:05:52.113 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e0003620 con 0x7f141408e4b0 2026-02-13T08:05:52.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015589031 0 0) 0x7f141405c930 con 0x7f141417fe50 2026-02-13T08:05:52.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): my global_id is 4394 2026-02-13T08:05:52.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14140884c0 con 0x7f141417fe50 2026-02-13T08:05:52.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 client.?.objecter ms_handle_connect 0x7f141408ef90 2026-02-13T08:05:52.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 123000140 0 0) 0x7f13e0003620 con 0x7f141408e4b0 2026-02-13T08:05:52.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f141405c930 con 0x7f141408e4b0 2026-02-13T08:05:52.114 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1408003180 con 0x7f141408e4b0 2026-02-13T08:05:52.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:52.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:52.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): dump: 2026-02-13T08:05:52.115 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.115 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.115 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.115 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.115 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.115 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.115 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.115 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4209066305 0 0) 0x7f14140884c0 con 0x7f141417fe50 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13e0003620 con 0x7f141417fe50 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f14040033b0 con 0x7f141417fe50 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient(hunting): dump: 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.116 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.117 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.117 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.117 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.117 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.117 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.117 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.117 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1154840734 0 0) 0x7f141405c930 con 0x7f141408e4b0 2026-02-13T08:05:52.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 >> v1:10.20.193.104:6790/0 conn(0x7f141417fe50 legacy=0x7f141419d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 >> v1:10.20.193.119:6789/0 conn(0x7f141408ef90 legacy=0x7f14140871e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.117 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:52.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 monclient: found mon.a 2026-02-13T08:05:52.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:52.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1414059d70 con 0x7f141408e4b0 2026-02-13T08:05:52.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:52.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:52.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:52.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 5 monclient: authenticate success, global_id 4410 2026-02-13T08:05:52.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: _renew_subs 2026-02-13T08:05:52.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.118 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- 10.20.193.104:0/1016113435 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1414187540 con 0x7f141408e4b0 2026-02-13T08:05:52.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 client.4410.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:52.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: _renew_subs 2026-02-13T08:05:52.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- 10.20.193.104:0/1016113435 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1414186020 con 0x7f141408e4b0 2026-02-13T08:05:52.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 librados: init done 2026-02-13T08:05:52.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1408003530 con 0x7f141408e4b0 2026-02-13T08:05:52.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:52.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1408003b60 con 0x7f141408e4b0 2026-02-13T08:05:52.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:52.119 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 monclient: dump: 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14117fa640 4 set_mon_vals no callback set 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:52.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14197b4640 1 -- 10.20.193.104:0/1016113435 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1414061860 con 0x7f141408e4b0 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f1408003d00 con 0x7f141408e4b0 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f140804a200 con 0x7f141408e4b0 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 client.4410.objecter ms_dispatch2 0x7f1414000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 3 client.4410.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 3 client.4410.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 20 client.4410.objecter dump_active .. 0 homeless 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f14127fc640 10 monclient: get_auth_request con 0x7f13e003b870 auth_method 0 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.088+0000 7f13f37fe640 10 client.4410.objecter ms_handle_connect 0x7f13e003b870 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.092+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f1408016c60 con 0x7f141408e4b0 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.092+0000 7f13f37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:52.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.092+0000 7f13f37fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:52.132 INFO:tasks.workunit:timeout=3h 2026-02-13T08:05:52.132 INFO:tasks.workunit:cleanup=True 2026-02-13T08:05:52.133 DEBUG:teuthology.orchestra.run.trial119:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T08:05:52.183 INFO:tasks.workunit.client.0.trial119.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-13T08:05:52.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:05:52.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:05:52.213 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.213 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 1 -- 10.20.193.104:0/1016113435 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f141408cc70 con 0x7f141408e4b0 2026-02-13T08:05:52.213 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f13f37fe640 1 -- 10.20.193.104:0/1016113435 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1475 (unknown 254746657 0 2332066327) 0x7f1408016560 con 0x7f141408e4b0 2026-02-13T08:05:52.213 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f13f37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:05:52.213 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f13f37fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:52.213 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":16,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:05:52.214 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 10 librados: watch_flush enter 2026-02-13T08:05:52.214 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 10 librados: watch_flush exit 2026-02-13T08:05:52.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 20 client.4410.objecter shutdown clearing up homeless session... 2026-02-13T08:05:52.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 10 client.4410.objecter successfully canceled tick 2026-02-13T08:05:52.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 1 -- 10.20.193.104:0/1016113435 >> v1:10.20.193.119:6812/276487904 conn(0x7f13e003b870 legacy=0x7f13e005bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 10 monclient: shutdown 2026-02-13T08:05:52.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:52.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 1 -- 10.20.193.104:0/1016113435 >> v1:10.20.193.104:6789/0 conn(0x7f141408e4b0 legacy=0x7f1414086ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 1 -- 10.20.193.104:0/1016113435 shutdown_connections 2026-02-13T08:05:52.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 1 -- 10.20.193.104:0/1016113435 >> 10.20.193.104:0/1016113435 conn(0x7f1414051e80 msgr2=0x7f141405b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:52.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 1 -- 10.20.193.104:0/1016113435 shutdown_connections 2026-02-13T08:05:52.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 1 -- 10.20.193.104:0/1016113435 wait complete. 2026-02-13T08:05:52.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.204+0000 7f14197b4640 1 librados: shutdown 2026-02-13T08:05:52.222 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T08:05:52.222 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T08:05:52.222 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T08:05:52.223 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T08:05:52.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 10 monclient: get_monmap_and_config 2026-02-13T08:05:52.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 10 monclient: build_initial_monmap 2026-02-13T08:05:52.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 10 monclient: monmap: 2026-02-13T08:05:52.294 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:52.294 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.294 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:52.290582+0000 2026-02-13T08:05:52.294 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:52.290582+0000 2026-02-13T08:05:52.294 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:52.294 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.295 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:52.295 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:52.295 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:52.295 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 1 Processor -- start 2026-02-13T08:05:52.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 1 -- start start 2026-02-13T08:05:52.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 10 monclient: init 2026-02-13T08:05:52.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:52.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:52.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 10 monclient(hunting): picked mon.noname-c con 0x7f3084090a00 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:52.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 10 monclient(hunting): picked mon.noname-a con 0x7f308408c7e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:52.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 10 monclient(hunting): picked mon.noname-b con 0x7f308408cbe0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:52.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3084057a20 con 0x7f308408c7e0 2026-02-13T08:05:52.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f308408ef90 con 0x7f3084090a00 2026-02-13T08:05:52.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f308408da30 con 0x7f308408cbe0 2026-02-13T08:05:52.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:52.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 10 monclient(hunting): authenticate will time out at 457.879464s 2026-02-13T08:05:52.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3088c22640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f308408c7e0 0x7f30841805b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42512/0 (socket says 10.20.193.104:42512) 2026-02-13T08:05:52.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3088c22640 1 -- 10.20.193.104:0/3290145541 learned_addr learned my addr 10.20.193.104:0/3290145541 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:52.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3089c24640 1 --1- 10.20.193.104:0/3290145541 >> v1:10.20.193.104:6790/0 conn(0x7f308408cbe0 0x7f30841a1ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40936/0 (socket says 10.20.193.104:40936) 2026-02-13T08:05:52.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150266379 0 0) 0x7f3084057a20 con 0x7f308408c7e0 2026-02-13T08:05:52.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): my global_id is 4413 2026-02-13T08:05:52.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f306c003620 con 0x7f308408c7e0 2026-02-13T08:05:52.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1599895144 0 0) 0x7f308408da30 con 0x7f308408cbe0 2026-02-13T08:05:52.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): my global_id is 4397 2026-02-13T08:05:52.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3084057a20 con 0x7f308408cbe0 2026-02-13T08:05:52.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354169864 0 0) 0x7f308408ef90 con 0x7f3084090a00 2026-02-13T08:05:52.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient(hunting): my global_id is 4378 2026-02-13T08:05:52.309 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f308408da30 con 0x7f3084090a00 2026-02-13T08:05:52.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4188542399 0 0) 0x7f306c003620 con 0x7f308408c7e0 2026-02-13T08:05:52.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 >> v1:10.20.193.104:6790/0 conn(0x7f308408cbe0 legacy=0x7f30841a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 >> v1:10.20.193.119:6789/0 conn(0x7f3084090a00 legacy=0x7f308408c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient: _finish_hunting 0 2026-02-13T08:05:52.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 monclient: found mon.noname-a 2026-02-13T08:05:52.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:52.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3084090f10 con 0x7f308408c7e0 2026-02-13T08:05:52.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient: _finish_auth 0 2026-02-13T08:05:52.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient: _check_auth_tickets 2026-02-13T08:05:52.310 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:52.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3078002e00 con 0x7f308408c7e0 2026-02-13T08:05:52.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 5 monclient: authenticate success, global_id 4413 2026-02-13T08:05:52.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f308b6ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:52.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.284+0000 7f3073fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3073fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:52.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3073fff640 10 monclient: dump: 2026-02-13T08:05:52.311 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.311 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.311 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.311 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.311 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.312 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.312 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.312 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.312 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.312 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:52.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f30780030c0 con 0x7f308408c7e0 2026-02-13T08:05:52.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3073fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:52.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3073fff640 1 -- 10.20.193.104:0/3290145541 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3078003490 con 0x7f308408c7e0 2026-02-13T08:05:52.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3073fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.312 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3073fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:52.313 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3073fff640 10 monclient: dump: 2026-02-13T08:05:52.313 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.313 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.313 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.313 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.313 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.313 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.313 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.313 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.313 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.313 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:52.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 4 set_mon_vals no callback set 2026-02-13T08:05:52.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient: shutdown 2026-02-13T08:05:52.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:52.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- 10.20.193.104:0/3290145541 >> v1:10.20.193.104:6789/0 conn(0x7f308408c7e0 legacy=0x7f30841805b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- 10.20.193.104:0/3290145541 shutdown_connections 2026-02-13T08:05:52.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- 10.20.193.104:0/3290145541 >> 10.20.193.104:0/3290145541 conn(0x7f308408e1d0 msgr2=0x7f308408e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:52.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- 10.20.193.104:0/3290145541 shutdown_connections 2026-02-13T08:05:52.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- 10.20.193.104:0/3290145541 wait complete. 2026-02-13T08:05:52.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient: build_initial_monmap 2026-02-13T08:05:52.314 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient: monmap: 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 librados: starting msgr at 2026-02-13T08:05:52.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 librados: starting objecter 2026-02-13T08:05:52.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 Processor -- start 2026-02-13T08:05:52.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- start start 2026-02-13T08:05:52.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 librados: setting wanted keys 2026-02-13T08:05:52.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 librados: calling monclient init 2026-02-13T08:05:52.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient: init 2026-02-13T08:05:52.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:52.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:52.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient(hunting): picked mon.noname-b con 0x7f308408c7e0 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:52.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient(hunting): picked mon.noname-a con 0x7f308408cbe0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:52.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient(hunting): picked mon.noname-c con 0x7f3084090a00 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:52.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f308405b940 con 0x7f308408cbe0 2026-02-13T08:05:52.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f308405df70 con 0x7f308408c7e0 2026-02-13T08:05:52.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30840888c0 con 0x7f3084090a00 2026-02-13T08:05:52.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:52.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient(hunting): authenticate will time out at 457.881143s 2026-02-13T08:05:52.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3088c22640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f308408cbe0 0x7f30841274e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42528/0 (socket says 10.20.193.104:42528) 2026-02-13T08:05:52.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3088c22640 1 -- 10.20.193.104:0/1067304674 learned_addr learned my addr 10.20.193.104:0/1067304674 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:52.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 client.?.objecter ms_handle_connect 0x7f308408cbe0 2026-02-13T08:05:52.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 client.?.objecter ms_handle_connect 0x7f3084090a00 2026-02-13T08:05:52.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.317 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3063419474 0 0) 0x7f3084090f10 con 0x7f308408cbe0 2026-02-13T08:05:52.318 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.318 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.318 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.318 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): my global_id is 4416 2026-02-13T08:05:52.318 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3054003620 con 0x7f308408cbe0 2026-02-13T08:05:52.318 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262611321 0 0) 0x7f30840888c0 con 0x7f3084090a00 2026-02-13T08:05:52.318 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.318 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.318 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.318 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): my global_id is 4400 2026-02-13T08:05:52.318 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3084090f10 con 0x7f3084090a00 2026-02-13T08:05:52.319 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 client.?.objecter ms_handle_connect 0x7f308408c7e0 2026-02-13T08:05:52.319 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.319 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3440545508 0 0) 0x7f3054003620 con 0x7f308408cbe0 2026-02-13T08:05:52.319 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30840888c0 con 0x7f308408cbe0 2026-02-13T08:05:52.319 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3078002dc0 con 0x7f308408cbe0 2026-02-13T08:05:52.319 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:52.319 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:52.319 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:52.319 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.319 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.319 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.320 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.320 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.320 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.320 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.320 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.320 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.320 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.320 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:52.320 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 801065018 0 0) 0x7f3084090f10 con 0x7f3084090a00 2026-02-13T08:05:52.320 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3054003620 con 0x7f3084090a00 2026-02-13T08:05:52.320 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3080003480 con 0x7f3084090a00 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): dump: 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.321 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.322 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3949514359 0 0) 0x7f30840888c0 con 0x7f308408cbe0 2026-02-13T08:05:52.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 >> v1:10.20.193.104:6790/0 conn(0x7f3084090a00 legacy=0x7f30841a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 >> v1:10.20.193.119:6789/0 conn(0x7f308408c7e0 legacy=0x7f3084126dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:52.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 monclient: found mon.a 2026-02-13T08:05:52.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:52.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3084087660 con 0x7f308408cbe0 2026-02-13T08:05:52.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 5 monclient: authenticate success, global_id 4416 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient: _renew_subs 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f308412c2e0 con 0x7f308408cbe0 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 client.4416.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient: _renew_subs 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f308405cc20 con 0x7f308408cbe0 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 librados: init done 2026-02-13T08:05:52.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3078002f60 con 0x7f308408cbe0 2026-02-13T08:05:52.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:52.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3078004d30 con 0x7f308408cbe0 2026-02-13T08:05:52.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:52.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: dump: 2026-02-13T08:05:52.324 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.324 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.324 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.324 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.324 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.324 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f30737fe640 4 set_mon_vals no callback set 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f308b6ae640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3084061860 con 0x7f3084116a00 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f3078010d40 con 0x7f308408cbe0 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 client.4416.objecter ms_handle_connect 0x7f3084116a00 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 client.4416.objecter resend_mon_ops 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f307804a090 con 0x7f308408cbe0 2026-02-13T08:05:52.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 client.4416.objecter ms_dispatch2 0x7f3084000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 3 client.4416.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 3 client.4416.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 20 client.4416.objecter dump_active .. 0 homeless 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1950866649 0 0) 0x7f3084061860 con 0x7f3084116a00 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient(hunting): my global_id is 4419 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30840888c0 con 0x7f3084116a00 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2998267785 0 0) 0x7f30840888c0 con 0x7f3084116a00 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3084061860 con 0x7f3084116a00 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3074002f90 con 0x7f3084116a00 2026-02-13T08:05:52.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: dump: 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3089c24640 10 monclient: get_auth_request con 0x7f305403b820 auth_method 0 2026-02-13T08:05:52.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4119850565 0 0) 0x7f3084061860 con 0x7f3084116a00 2026-02-13T08:05:52.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30841a3610 con 0x7f3084116a00 2026-02-13T08:05:52.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 client.4416.objecter ms_handle_connect 0x7f305403b820 2026-02-13T08:05:52.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f3074002db0 con 0x7f3084116a00 2026-02-13T08:05:52.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:52.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:52.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 >> v1:10.20.193.104:6789/0 conn(0x7f3084116a00 legacy=0x7f30841a2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.288+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 >> v1:10.20.193.104:6789/0 conn(0x7f3084116a00 legacy=0x7f30841a2cf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:05:52.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:05:52.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3084132240 con 0x7f3084130720 2026-02-13T08:05:52.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 10 client.4416.objecter ms_handle_connect 0x7f3084130720 2026-02-13T08:05:52.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 10 client.4416.objecter resend_mon_ops 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3870466889 0 0) 0x7f3084132240 con 0x7f3084130720 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 10 monclient(hunting): my global_id is 4422 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3084061860 con 0x7f3084130720 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3489788828 0 0) 0x7f3084061860 con 0x7f3084130720 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3084132240 con 0x7f3084130720 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f30740038b0 con 0x7f3084130720 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 10 monclient: dump: 2026-02-13T08:05:52.329 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3375548671 0 0) 0x7f3084132240 con 0x7f3084130720 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 --> v1:10.20.193.104:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f30841345a0 con 0x7f3084130720 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4326 (unknown 0 0 473364521) 0x7f30740038a0 con 0x7f3084130720 2026-02-13T08:05:52.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:05:52.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:52.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 >> v1:10.20.193.104:6789/0 conn(0x7f3084130720 legacy=0x7f3084130b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3071ffb640 1 -- 10.20.193.104:0/1067304674 >> v1:10.20.193.104:6789/0 conn(0x7f3084130720 legacy=0x7f3084130b20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:05:52.331 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:05:52.331 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:05:52.331 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:05:52.331 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:05:52.331 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 8, 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 21703, 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 16, 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:05:52.332 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:05:52.333 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:05:52.334 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:05:52.335 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:05:52.336 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.337 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.338 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:05:52.339 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.340 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: "num": 2 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:05:52.341 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 10 librados: watch_flush enter 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 10 librados: watch_flush exit 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 20 client.4416.objecter shutdown clearing up homeless session... 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 10 client.4416.objecter successfully canceled tick 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 1 -- 10.20.193.104:0/1067304674 >> v1:10.20.193.119:6812/276487904 conn(0x7f305403b820 legacy=0x7f305405bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 10 monclient: shutdown 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 1 -- 10.20.193.104:0/1067304674 >> v1:10.20.193.104:6789/0 conn(0x7f308408cbe0 legacy=0x7f30841274e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3089c24640 1 -- 10.20.193.104:0/1067304674 reap_dead start 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f3089c24640 1 -- 10.20.193.104:0/1067304674 reap_dead start 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 1 -- 10.20.193.104:0/1067304674 shutdown_connections 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 1 -- 10.20.193.104:0/1067304674 >> 10.20.193.104:0/1067304674 conn(0x7f308408e1d0 msgr2=0x7f3084085e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 1 -- 10.20.193.104:0/1067304674 shutdown_connections 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 1 -- 10.20.193.104:0/1067304674 wait complete. 2026-02-13T08:05:52.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.292+0000 7f308b6ae640 1 librados: shutdown 2026-02-13T08:05:52.344 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:05:52.344 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T08:05:52.344 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T08:05:52.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient: get_monmap_and_config 2026-02-13T08:05:52.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient: build_initial_monmap 2026-02-13T08:05:52.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient: monmap: 2026-02-13T08:05:52.404 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:52.405 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.405 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:52.402184+0000 2026-02-13T08:05:52.405 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:52.402184+0000 2026-02-13T08:05:52.405 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:52.405 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.405 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:52.405 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:52.405 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:52.405 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 1 Processor -- start 2026-02-13T08:05:52.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 1 -- start start 2026-02-13T08:05:52.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient: init 2026-02-13T08:05:52.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:52.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:05:52.412 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient(hunting): picked mon.noname-c con 0x7f5540139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:52.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient(hunting): picked mon.noname-a con 0x7f554015e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:52.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient(hunting): picked mon.noname-b con 0x7f554017fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:52.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f554013aa00 con 0x7f554015e200 2026-02-13T08:05:52.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f554008ba20 con 0x7f5540139f20 2026-02-13T08:05:52.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5540089e30 con 0x7f554017fd00 2026-02-13T08:05:52.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:52.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient(hunting): authenticate will time out at 457.991290s 2026-02-13T08:05:52.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553f7fe640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f554017fd00 0x7f55401a00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:40962/0 (socket says 10.20.193.104:40962) 2026-02-13T08:05:52.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553f7fe640 1 -- 10.20.193.104:0/1650902435 learned_addr learned my addr 10.20.193.104:0/1650902435 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:52.413 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553e7fc640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f554015e200 0x7f554017e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42556/0 (socket says 10.20.193.104:42556) 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887726930 0 0) 0x7f5540089e30 con 0x7f554017fd00 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): my global_id is 4403 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f552c003620 con 0x7f554017fd00 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255043477 0 0) 0x7f5528002920 con 0x7f554015e200 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): my global_id is 4425 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5540089e30 con 0x7f554015e200 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2520107073 0 0) 0x7f554008ba20 con 0x7f5540139f20 2026-02-13T08:05:52.414 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient(hunting): my global_id is 4384 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5528002920 con 0x7f5540139f20 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 375176445 0 0) 0x7f552c003620 con 0x7f554017fd00 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 >> v1:10.20.193.119:6789/0 conn(0x7f5540139f20 legacy=0x7f554013a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 >> v1:10.20.193.104:6789/0 conn(0x7f554015e200 legacy=0x7f554017e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient: _finish_hunting 0 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 monclient: found mon.noname-b 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554008a380 con 0x7f554017fd00 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient: _finish_auth 0 2026-02-13T08:05:52.415 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient: _check_auth_tickets 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5530003180 con 0x7f554017fd00 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient: dump: 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.416 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 5 monclient: authenticate success, global_id 4403 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5530003320 con 0x7f554017fd00 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 1 -- 10.20.193.104:0/1650902435 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5530003760 con 0x7f554017fd00 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f553dffb640 10 monclient: dump: 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.417 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.396+0000 7f5545689640 4 set_mon_vals no callback set 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient: shutdown 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- 10.20.193.104:0/1650902435 >> v1:10.20.193.104:6790/0 conn(0x7f554017fd00 legacy=0x7f55401a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- 10.20.193.104:0/1650902435 shutdown_connections 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- 10.20.193.104:0/1650902435 >> 10.20.193.104:0/1650902435 conn(0x7f5540051a50 msgr2=0x7f5540051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:52.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- 10.20.193.104:0/1650902435 shutdown_connections 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- 10.20.193.104:0/1650902435 wait complete. 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient: build_initial_monmap 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient: monmap: 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 librados: starting msgr at 2026-02-13T08:05:52.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 librados: starting objecter 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 Processor -- start 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- start start 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 librados: setting wanted keys 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 librados: calling monclient init 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient: init 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient(hunting): picked mon.noname-a con 0x7f5540139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient(hunting): picked mon.noname-c con 0x7f554015e200 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient(hunting): picked mon.noname-b con 0x7f554017fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5540087780 con 0x7f5540139f20 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55401650e0 con 0x7f554017fd00 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f554005cb60 con 0x7f554015e200 2026-02-13T08:05:52.420 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient(hunting): authenticate will time out at 457.993271s 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f553effd640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f5540139f20 0x7f5540086960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42560/0 (socket says 10.20.193.104:42560) 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f553effd640 1 -- 10.20.193.104:0/46176590 learned_addr learned my addr 10.20.193.104:0/46176590 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 client.?.objecter ms_handle_connect 0x7f5540139f20 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 client.?.objecter ms_handle_connect 0x7f554015e200 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68849990 0 0) 0x7f5540087780 con 0x7f5540139f20 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): my global_id is 4428 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f550c003620 con 0x7f5540139f20 2026-02-13T08:05:52.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177072552 0 0) 0x7f554005cb60 con 0x7f554015e200 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): my global_id is 4406 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5540087780 con 0x7f554015e200 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 client.?.objecter ms_handle_connect 0x7f554017fd00 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1741265987 0 0) 0x7f550c003620 con 0x7f5540139f20 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f554005cb60 con 0x7f5540139f20 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5534003180 con 0x7f5540139f20 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.422 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3587153284 0 0) 0x7f5540087780 con 0x7f554015e200 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f550c003620 con 0x7f554015e200 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5528002d80 con 0x7f554015e200 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:52.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): dump: 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4212041847 0 0) 0x7f554005cb60 con 0x7f5540139f20 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 >> v1:10.20.193.104:6790/0 conn(0x7f554015e200 legacy=0x7f5540087070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 >> v1:10.20.193.119:6789/0 conn(0x7f554017fd00 legacy=0x7f5540126aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 monclient: found mon.a 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554013c6d0 con 0x7f5540139f20 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 5 monclient: authenticate success, global_id 4428 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient: _renew_subs 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5540086620 con 0x7f5540139f20 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 client.4428.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:52.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient: _renew_subs 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5540164e00 con 0x7f5540139f20 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 librados: init done 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5534003320 con 0x7f5540139f20 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5534003b60 con 0x7f5540139f20 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: dump: 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.426 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f553d7fa640 4 set_mon_vals no callback set 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f5545689640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f554017de10 con 0x7f5540059a10 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f5534003d00 con 0x7f5540139f20 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 client.4428.objecter ms_handle_connect 0x7f5540059a10 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 client.4428.objecter resend_mon_ops 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f553404a260 con 0x7f5540139f20 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 client.4428.objecter ms_dispatch2 0x7f5540000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:52.427 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 3 client.4428.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 3 client.4428.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 20 client.4428.objecter dump_active .. 0 homeless 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4268490132 0 0) 0x7f554017de10 con 0x7f5540059a10 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient(hunting): my global_id is 4409 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f554005cb60 con 0x7f5540059a10 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2506659113 0 0) 0x7f554005cb60 con 0x7f5540059a10 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f554017de10 con 0x7f5540059a10 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5528004a80 con 0x7f5540059a10 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: dump: 2026-02-13T08:05:52.428 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f553f7fe640 10 monclient: get_auth_request con 0x7f550c03b890 auth_method 0 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3017649930 0 0) 0x7f554017de10 con 0x7f5540059a10 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5540061860 con 0x7f5540059a10 2026-02-13T08:05:52.429 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 client.4428.objecter ms_handle_connect 0x7f550c03b890 2026-02-13T08:05:52.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f5528006130 con 0x7f5540059a10 2026-02-13T08:05:52.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:52.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:52.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 >> v1:10.20.193.104:6790/0 conn(0x7f5540059a10 legacy=0x7f554004ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.430 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.400+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 >> v1:10.20.193.104:6790/0 conn(0x7f5540059a10 legacy=0x7f554004ca00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:05:52.431 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:05:52.431 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f554004d110 con 0x7f5540059de0 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 10 client.4428.objecter ms_handle_connect 0x7f5540059de0 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 10 client.4428.objecter resend_mon_ops 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114451356 0 0) 0x7f554004d110 con 0x7f5540059de0 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 10 monclient(hunting): my global_id is 4412 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f554017de10 con 0x7f5540059de0 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1436058233 0 0) 0x7f554017de10 con 0x7f5540059de0 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f554004d110 con 0x7f5540059de0 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f5528006780 con 0x7f5540059de0 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 10 monclient: dump: 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2611226575 0 0) 0x7f554004d110 con 0x7f5540059de0 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 --> v1:10.20.193.104:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5540088e20 con 0x7f5540059de0 2026-02-13T08:05:52.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4324 (unknown 0 0 4062252653) 0x7f55280065e0 con 0x7f5540059de0 2026-02-13T08:05:52.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:05:52.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:52.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 >> v1:10.20.193.104:6790/0 conn(0x7f5540059de0 legacy=0x7f55401291d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f551f7fe640 1 -- 10.20.193.104:0/46176590 >> v1:10.20.193.104:6790/0 conn(0x7f5540059de0 legacy=0x7f55401291d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:05:52.434 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:05:52.434 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:05:52.434 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:05:52.434 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:05:52.434 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 8, 2026-02-13T08:05:52.434 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 21811, 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 16, 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:05:52.435 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:05:52.436 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:05:52.437 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:05:52.438 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:05:52.439 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.440 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:05:52.441 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:05:52.442 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: "num": 2 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:05:52.443 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:05:52.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 10 librados: watch_flush enter 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 10 librados: watch_flush exit 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 20 client.4428.objecter shutdown clearing up homeless session... 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 10 client.4428.objecter successfully canceled tick 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 1 -- 10.20.193.104:0/46176590 >> v1:10.20.193.119:6812/276487904 conn(0x7f550c03b890 legacy=0x7f550c05bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 10 monclient: shutdown 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 1 -- 10.20.193.104:0/46176590 >> v1:10.20.193.104:6789/0 conn(0x7f5540139f20 legacy=0x7f5540086960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f553f7fe640 1 -- 10.20.193.104:0/46176590 reap_dead start 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f553f7fe640 1 -- 10.20.193.104:0/46176590 reap_dead start 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 1 -- 10.20.193.104:0/46176590 shutdown_connections 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 1 -- 10.20.193.104:0/46176590 >> 10.20.193.104:0/46176590 conn(0x7f5540051a50 msgr2=0x7f554013bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 1 -- 10.20.193.104:0/46176590 shutdown_connections 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 1 -- 10.20.193.104:0/46176590 wait complete. 2026-02-13T08:05:52.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.404+0000 7f5545689640 1 librados: shutdown 2026-02-13T08:05:52.446 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:05:52.446 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T08:05:52.446 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T08:05:52.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 10 monclient: get_monmap_and_config 2026-02-13T08:05:52.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 10 monclient: build_initial_monmap 2026-02-13T08:05:52.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 10 monclient: monmap: 2026-02-13T08:05:52.505 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:52.505 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.505 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:52.502860+0000 2026-02-13T08:05:52.505 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:52.502860+0000 2026-02-13T08:05:52.505 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:52.506 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.506 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:52.506 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:05:52.506 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:05:52.506 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 1 Processor -- start 2026-02-13T08:05:52.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 1 -- start start 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 10 monclient: init 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 10 monclient(hunting): picked mon.noname-b con 0x7f9570091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 10 monclient(hunting): picked mon.noname-c con 0x7f957013f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 10 monclient(hunting): picked mon.noname-a con 0x7f957013fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f957008e5f0 con 0x7f957013fcd0 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f957008e8d0 con 0x7f957013f870 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f957008ebb0 con 0x7f9570091740 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9576d59640 10 monclient(hunting): authenticate will time out at 458.091642s 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9574ace640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f9570091740 0x7f957013f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:41012/0 (socket says 10.20.193.104:41012) 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f9574ace640 1 -- 10.20.193.104:0/405999637 learned_addr learned my addr 10.20.193.104:0/405999637 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:52.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128191083 0 0) 0x7f957008ebb0 con 0x7f9570091740 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 10 monclient(hunting): my global_id is 4415 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f955c003620 con 0x7f9570091740 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3490995300 0 0) 0x7f957008e5f0 con 0x7f957013fcd0 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 10 monclient(hunting): my global_id is 4431 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.496+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f957008ebb0 con 0x7f957013fcd0 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2365687792 0 0) 0x7f957008e8d0 con 0x7f957013f870 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient(hunting): my global_id is 4390 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f957008e5f0 con 0x7f957013f870 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 897982399 0 0) 0x7f955c003620 con 0x7f9570091740 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 >> v1:10.20.193.119:6789/0 conn(0x7f957013f870 legacy=0x7f9570180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 >> v1:10.20.193.104:6789/0 conn(0x7f957013fcd0 legacy=0x7f95701a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient: _finish_hunting 0 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 1 monclient: found mon.noname-b 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9570091b10 con 0x7f9570091740 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient: _finish_auth 0 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient: _check_auth_tickets 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9560002d80 con 0x7f9570091740 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient: dump: 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 5 monclient: authenticate success, global_id 4415 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9560002f50 con 0x7f9570091740 2026-02-13T08:05:52.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 1 -- 10.20.193.104:0/405999637 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9560003390 con 0x7f9570091740 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95677fe640 10 monclient: dump: 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient: get_monmap_and_config success 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 4 set_mon_vals no callback set 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient: shutdown 2026-02-13T08:05:52.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- 10.20.193.104:0/405999637 >> v1:10.20.193.104:6790/0 conn(0x7f9570091740 legacy=0x7f957013f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- 10.20.193.104:0/405999637 shutdown_connections 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- 10.20.193.104:0/405999637 >> 10.20.193.104:0/405999637 conn(0x7f9570090810 msgr2=0x7f9570090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- 10.20.193.104:0/405999637 shutdown_connections 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- 10.20.193.104:0/405999637 wait complete. 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient: build_initial_monmap 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient: monmap: 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:05:52.520 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 librados: starting msgr at 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 librados: starting objecter 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 Processor -- start 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- start start 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 librados: setting wanted keys 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 librados: calling monclient init 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient: init 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient: _reopen_session rank -1 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient(hunting): picked mon.noname-a con 0x7f9570091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient(hunting): picked mon.noname-b con 0x7f957013f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient(hunting): picked mon.noname-c con 0x7f957013fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95700593e0 con 0x7f9570091740 2026-02-13T08:05:52.521 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f957008ab30 con 0x7f957013f870 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f957012dc70 con 0x7f957013fcd0 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient(hunting): _renew_subs 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient(hunting): authenticate will time out at 458.093461s 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95752cf640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f957013fcd0 0x7f95701922f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:41014/0 (socket says 10.20.193.104:41014) 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95752cf640 1 -- 10.20.193.104:0/1995654524 learned_addr learned my addr 10.20.193.104:0/1995654524 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9574ace640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f9570091740 0x7f957014f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:42586/0 (socket says 10.20.193.104:42586) 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 client.?.objecter ms_handle_connect 0x7f957013fcd0 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 client.?.objecter ms_handle_connect 0x7f9570091740 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 124312350 0 0) 0x7f957012dc70 con 0x7f957013fcd0 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): my global_id is 4418 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9540003620 con 0x7f957013fcd0 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1750444545 0 0) 0x7f95700593e0 con 0x7f9570091740 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): my global_id is 4434 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f957012dc70 con 0x7f9570091740 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 client.?.objecter ms_handle_connect 0x7f957013f870 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1370337196 0 0) 0x7f9540003620 con 0x7f957013fcd0 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95700593e0 con 0x7f957013fcd0 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 840040934 0 0) 0x7f957012dc70 con 0x7f9570091740 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9540003620 con 0x7f9570091740 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f956c003470 con 0x7f957013fcd0 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:52.523 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): dump: 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9560003100 con 0x7f9570091740 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:05:52.524 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): dump: 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2298377537 0 0) 0x7f957008ab30 con 0x7f957013f870 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.525 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): my global_id is 4393 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f957012dc70 con 0x7f957013f870 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1460979327 0 0) 0x7f95700593e0 con 0x7f957013fcd0 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 >> v1:10.20.193.119:6789/0 conn(0x7f957013f870 legacy=0x7f9570190bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 >> v1:10.20.193.104:6789/0 conn(0x7f9570091740 legacy=0x7f957014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: _finish_hunting 0 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 monclient: found mon.c 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957012ffd0 con 0x7f957013fcd0 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: _finish_auth 0 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: _check_auth_tickets 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 5 monclient: authenticate success, global_id 4418 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient: _renew_subs 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:52.526 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f957012e7d0 con 0x7f957013fcd0 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 client.4418.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient: _renew_subs 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f957012d210 con 0x7f957013fcd0 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 librados: init done 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f956c003610 con 0x7f957013fcd0 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f956c003d40 con 0x7f957013fcd0 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: dump: 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.527 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9566ffd640 4 set_mon_vals no callback set 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9576d59640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f95700587a0 con 0x7f95701500d0 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f956c003ee0 con 0x7f957013fcd0 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 client.4418.objecter ms_handle_connect 0x7f95701500d0 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 client.4418.objecter resend_mon_ops 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f956c04a4e0 con 0x7f957013fcd0 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 client.4418.objecter ms_dispatch2 0x7f9570000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 3 client.4418.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 3 client.4418.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:05:52.528 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 20 client.4418.objecter dump_active .. 0 homeless 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021810937 0 0) 0x7f95700587a0 con 0x7f95701500d0 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient(hunting): my global_id is 4396 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95700593e0 con 0x7f95701500d0 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f9567fff640 10 monclient: get_auth_request con 0x7f954003bb30 auth_method 0 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 499862408 0 0) 0x7f95700593e0 con 0x7f95701500d0 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95700587a0 con 0x7f95701500d0 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9560004b90 con 0x7f95701500d0 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: dump: 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.529 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 client.4418.objecter ms_handle_connect 0x7f954003bb30 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4142714953 0 0) 0x7f95700587a0 con 0x7f95701500d0 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.119:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9570061860 con 0x7f95701500d0 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f9560006070 con 0x7f95701500d0 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 >> v1:10.20.193.119:6789/0 conn(0x7f95701500d0 legacy=0x7f9570088990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.500+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 >> v1:10.20.193.119:6789/0 conn(0x7f95701500d0 legacy=0x7f9570088990 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f9576d59640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f9576d59640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f95701504a0 con 0x7f957004ca00 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 10 client.4418.objecter ms_handle_connect 0x7f957004ca00 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 10 client.4418.objecter resend_mon_ops 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086682014 0 0) 0x7f95701504a0 con 0x7f957004ca00 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 10 monclient(hunting): _negotiate 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 10 monclient(hunting): my global_id is 4399 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95700587a0 con 0x7f957004ca00 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1143701493 0 0) 0x7f95700587a0 con 0x7f957004ca00 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95701504a0 con 0x7f957004ca00 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9560006620 con 0x7f957004ca00 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:05:52.531 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 10 monclient: dump: 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3831428338 0 0) 0x7f95701504a0 con 0x7f957004ca00 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 --> v1:10.20.193.119:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f957012d500 con 0x7f957004ca00 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4491 (unknown 0 0 3740752191) 0x7f9560006660 con 0x7f957004ca00 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:05:52.532 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:05:52.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 >> v1:10.20.193.119:6789/0 conn(0x7f957004ca00 legacy=0x7f9570194a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.533 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.504+0000 7f95657fa640 1 -- 10.20.193.104:0/1995654524 >> v1:10.20.193.119:6789/0 conn(0x7f957004ca00 legacy=0x7f9570194a20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:05:52.533 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:05:52.533 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:05:52.533 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:05:52.533 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:05:52.533 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 8, 2026-02-13T08:05:52.533 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 21879, 2026-02-13T08:05:52.533 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:05:52.533 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 16, 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:05:52.534 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:05:52.535 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:05:52.536 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:05:52.537 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:05:52.538 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:05:52.539 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:05:52.540 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: "num": 3 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.541 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:05:52.542 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 10 librados: watch_flush enter 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 10 librados: watch_flush exit 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 20 client.4418.objecter shutdown clearing up homeless session... 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 10 client.4418.objecter successfully canceled tick 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 1 -- 10.20.193.104:0/1995654524 >> v1:10.20.193.119:6812/276487904 conn(0x7f954003bb30 legacy=0x7f954005bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 10 monclient: shutdown 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 1 -- 10.20.193.104:0/1995654524 >> v1:10.20.193.104:6790/0 conn(0x7f957013fcd0 legacy=0x7f95701922f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f95752cf640 1 -- 10.20.193.104:0/1995654524 reap_dead start 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f95752cf640 1 -- 10.20.193.104:0/1995654524 reap_dead start 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 1 -- 10.20.193.104:0/1995654524 shutdown_connections 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 1 -- 10.20.193.104:0/1995654524 >> 10.20.193.104:0/1995654524 conn(0x7f9570090810 msgr2=0x7f9570058090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 1 -- 10.20.193.104:0/1995654524 shutdown_connections 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 1 -- 10.20.193.104:0/1995654524 wait complete. 2026-02-13T08:05:52.544 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:05:52.508+0000 7f9576d59640 1 librados: shutdown 2026-02-13T08:05:52.545 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:05:52.545 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b'] 2026-02-13T08:05:52.545 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-13T08:05:52.545 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2026-02-13T08:05:52.545 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2026-02-13T08:05:52.545 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-13T08:05:52.545 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:05:52.557 INFO:tasks.ceph.mon.b:Stopped 2026-02-13T08:05:52.557 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-13T08:05:52.557 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-13T08:05:52.558 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T08:06:07.558 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-13T08:06:07.559 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-13T08:06:07.559 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T08:06:07.559 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:06:07.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.615+0000 7f625f44e640 10 monclient: get_monmap_and_config 2026-02-13T08:06:07.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.615+0000 7f625f44e640 10 monclient: build_initial_monmap 2026-02-13T08:06:07.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.615+0000 7f625f44e640 10 monclient: monmap: 2026-02-13T08:06:07.622 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:06:07.622 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:07.622 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:06:07.619414+0000 2026-02-13T08:06:07.623 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:06:07.619414+0000 2026-02-13T08:06:07.623 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:06:07.623 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:07.623 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:06:07.623 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:06:07.623 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:06:07.623 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:07.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.615+0000 7f625f44e640 1 Processor -- start 2026-02-13T08:06:07.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.615+0000 7f625f44e640 1 -- start start 2026-02-13T08:06:07.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.615+0000 7f625f44e640 10 monclient: init 2026-02-13T08:06:07.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625f44e640 10 monclient: _reopen_session rank -1 2026-02-13T08:06:07.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625f44e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:06:07.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625f44e640 10 monclient(hunting): picked mon.noname-b con 0x7f625808c160 addr v1:10.20.193.104:6790/0 2026-02-13T08:06:07.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625f44e640 10 monclient(hunting): picked mon.noname-a con 0x7f625808cc40 addr v1:10.20.193.104:6789/0 2026-02-13T08:06:07.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625f44e640 10 monclient(hunting): picked mon.noname-c con 0x7f6258182010 addr v1:10.20.193.119:6789/0 2026-02-13T08:06:07.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625f44e640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6258057c90 con 0x7f625808cc40 2026-02-13T08:06:07.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625f44e640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625808d5b0 con 0x7f6258182010 2026-02-13T08:06:07.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625f44e640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6258085400 con 0x7f625808c160 2026-02-13T08:06:07.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625f44e640 10 monclient(hunting): _renew_subs 2026-02-13T08:06:07.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625f44e640 10 monclient(hunting): authenticate will time out at 473.208163s 2026-02-13T08:06:07.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625d1c3640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f625808c160 0x7f625808c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:53998/0 (socket says 10.20.193.104:53998) 2026-02-13T08:06:07.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625d1c3640 1 -- 10.20.193.104:0/358207208 learned_addr learned my addr 10.20.193.104:0/358207208 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:06:07.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.619+0000 7f625d9c4640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.119:6789/0 conn(0x7f6258182010 legacy=0x7f62581a23f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:07.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:07.823+0000 7f625d9c4640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.119:6789/0 conn(0x7f6258182010 legacy=0x7f62581a23f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:08.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:08.227+0000 7f625d9c4640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.119:6789/0 conn(0x7f6258182010 legacy=0x7f62581a23f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:09.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:09.031+0000 7f625d9c4640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.119:6789/0 conn(0x7f6258182010 legacy=0x7f62581a23f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:10.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 10 monclient(hunting): tick 2026-02-13T08:06:10.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-13T08:06:10.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 1 monclient(hunting): continuing hunt 2026-02-13T08:06:10.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T08:06:10.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.104:6790/0 conn(0x7f625808c160 legacy=0x7f625808c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:10.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.119:6789/0 conn(0x7f6258182010 legacy=0x7f62581a23f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:06:10.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.104:6789/0 conn(0x7f625808cc40 legacy=0x7f62581808f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:10.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:06:10.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 10 monclient(hunting): picked mon.noname-b con 0x7f625808c160 addr v1:10.20.193.104:6790/0 2026-02-13T08:06:10.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f625808cc40 addr v1:10.20.193.104:6789/0 2026-02-13T08:06:10.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 10 monclient(hunting): picked mon.noname-c con 0x7f6258182010 addr v1:10.20.193.119:6789/0 2026-02-13T08:06:10.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 1 -- 10.20.193.104:0/358207208 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6258091400 con 0x7f625808cc40 2026-02-13T08:06:10.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 1 -- 10.20.193.104:0/358207208 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625808d5b0 con 0x7f6258182010 2026-02-13T08:06:10.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 1 -- 10.20.193.104:0/358207208 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f623c069ff0 con 0x7f625808c160 2026-02-13T08:06:10.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f6246ffd640 10 monclient(hunting): _renew_subs 2026-02-13T08:06:10.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.619+0000 7f625d9c4640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.119:6789/0 conn(0x7f6258182010 legacy=0x7f623c0667d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:10.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:10.823+0000 7f625d9c4640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.119:6789/0 conn(0x7f6258182010 legacy=0x7f623c0667d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:11.227+0000 7f625d9c4640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.119:6789/0 conn(0x7f6258182010 legacy=0x7f623c0667d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:12.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.031+0000 7f625d9c4640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.119:6789/0 conn(0x7f6258182010 legacy=0x7f623c0667d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:12.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.583+0000 7f6247fff640 1 -- 10.20.193.104:0/358207208 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254037596 0 0) 0x7f623c069ff0 con 0x7f625808c160 2026-02-13T08:06:12.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.583+0000 7f6247fff640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.583+0000 7f6247fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.583+0000 7f6247fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.583+0000 7f6247fff640 10 monclient(hunting): my global_id is 4421 2026-02-13T08:06:12.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.583+0000 7f6247fff640 1 -- 10.20.193.104:0/358207208 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6240003620 con 0x7f625808c160 2026-02-13T08:06:12.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 1 -- 10.20.193.104:0/358207208 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1584895365 0 0) 0x7f6240003620 con 0x7f625808c160 2026-02-13T08:06:12.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.119:6789/0 conn(0x7f6258182010 legacy=0x7f623c0667d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:06:12.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.104:6789/0 conn(0x7f625808cc40 legacy=0x7f623c044fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 10 monclient: _finish_hunting 0 2026-02-13T08:06:12.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 1 monclient: found mon.noname-b 2026-02-13T08:06:12.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:06:12.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:06:12.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 1 -- 10.20.193.104:0/358207208 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623c06b290 con 0x7f625808c160 2026-02-13T08:06:12.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 10 monclient: _finish_auth 0 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 10 monclient: _check_auth_tickets 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 1 -- 10.20.193.104:0/358207208 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6248002dc0 con 0x7f625808c160 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 10 monclient: dump: 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.598 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.599 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.599 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.599 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 5 monclient: authenticate success, global_id 4421 2026-02-13T08:06:12.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:06:12.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 1 -- 10.20.193.104:0/358207208 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6248003000 con 0x7f625808c160 2026-02-13T08:06:12.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:06:12.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 1 -- 10.20.193.104:0/358207208 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6248003440 con 0x7f625808c160 2026-02-13T08:06:12.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:06:12.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6247fff640 10 monclient: dump: 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: get_monmap_and_config success 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 4 set_mon_vals no callback set 2026-02-13T08:06:12.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: shutdown 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- 10.20.193.104:0/358207208 >> v1:10.20.193.104:6790/0 conn(0x7f625808c160 legacy=0x7f623c0237f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- 10.20.193.104:0/358207208 shutdown_connections 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- 10.20.193.104:0/358207208 >> 10.20.193.104:0/358207208 conn(0x7f625808e860 msgr2=0x7f625808f660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- 10.20.193.104:0/358207208 shutdown_connections 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- 10.20.193.104:0/358207208 wait complete. 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: build_initial_monmap 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: monmap: 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:06:12.601 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 librados: starting msgr at 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 librados: starting objecter 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 Processor -- start 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- start start 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 librados: setting wanted keys 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 librados: calling monclient init 2026-02-13T08:06:12.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: init 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: _reopen_session rank -1 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient(hunting): picked mon.noname-b con 0x7f625808c160 addr v1:10.20.193.119:6789/0 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient(hunting): picked mon.noname-a con 0x7f625808cc40 addr v1:10.20.193.104:6789/0 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient(hunting): picked mon.noname-c con 0x7f6258182010 addr v1:10.20.193.104:6790/0 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6258088950 con 0x7f625808cc40 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625805be80 con 0x7f625808c160 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625807b990 con 0x7f6258182010 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient(hunting): _renew_subs 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient(hunting): authenticate will time out at 478.177969s 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625d9c4640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f6258182010 0x7f6258171ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:54012/0 (socket says 10.20.193.104:54012) 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625d1c3640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f625808c160 legacy=0x7f6258083f10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:12.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625d9c4640 1 -- 10.20.193.104:0/2748331007 learned_addr learned my addr 10.20.193.104:0/2748331007 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 client.?.objecter ms_handle_connect 0x7f6258182010 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 147950933 0 0) 0x7f625807b990 con 0x7f6258182010 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient(hunting): my global_id is 4424 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6228003620 con 0x7f6258182010 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 client.?.objecter ms_handle_connect 0x7f625808cc40 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2967199793 0 0) 0x7f6228003620 con 0x7f6258182010 2026-02-13T08:06:12.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f625807b990 con 0x7f6258182010 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6254004770 con 0x7f6258182010 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient(hunting): dump: 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.605 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2885316163 0 0) 0x7f625807b990 con 0x7f6258182010 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 >> v1:10.20.193.119:6789/0 conn(0x7f625808c160 legacy=0x7f6258083f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 >> v1:10.20.193.104:6789/0 conn(0x7f625808cc40 legacy=0x7f62581707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 monclient: found mon.c 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625805df00 con 0x7f6258182010 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient: _finish_auth 0 2026-02-13T08:06:12.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 5 monclient: authenticate success, global_id 4424 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: _renew_subs 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- 10.20.193.104:0/2748331007 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f625805cc00 con 0x7f6258182010 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 client.4424.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: _renew_subs 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- 10.20.193.104:0/2748331007 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6258084620 con 0x7f6258182010 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 librados: init done 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6254004c00 con 0x7f6258182010 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:06:12.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6254004f90 con 0x7f6258182010 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 monclient: dump: 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.608 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f62477fe640 4 set_mon_vals no callback set 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625f44e640 1 -- 10.20.193.104:0/2748331007 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6258061860 con 0x7f6258182010 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f62540051b0 con 0x7f6258182010 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f625404a7c0 con 0x7f6258182010 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 client.4424.objecter ms_dispatch2 0x7f6258000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 3 client.4424.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 3 client.4424.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 20 client.4424.objecter dump_active .. 0 homeless 2026-02-13T08:06:12.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f625d1c3640 10 monclient: get_auth_request con 0x7f622803b6a0 auth_method 0 2026-02-13T08:06:12.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.587+0000 7f6245ffb640 10 client.4424.objecter ms_handle_connect 0x7f622803b6a0 2026-02-13T08:06:12.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.591+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f62540171c0 con 0x7f6258182010 2026-02-13T08:06:12.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.591+0000 7f6245ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:06:12.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.591+0000 7f6245ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:06:12.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:06:12.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:06:12.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:12.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 1 -- 10.20.193.104:0/2748331007 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f625808c530 con 0x7f6258182010 2026-02-13T08:06:12.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f6245ffb640 1 -- 10.20.193.104:0/2748331007 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1469 (unknown 254746657 0 1334892446) 0x7f6254016ac0 con 0x7f6258182010 2026-02-13T08:06:12.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f6245ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:06:12.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f6245ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:06:12.713 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":12,"quorum":[0,2],"quorum_names":["a","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:06:12.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 10 librados: watch_flush enter 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 10 librados: watch_flush exit 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 20 client.4424.objecter shutdown clearing up homeless session... 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 10 client.4424.objecter successfully canceled tick 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 1 -- 10.20.193.104:0/2748331007 >> v1:10.20.193.119:6812/276487904 conn(0x7f622803b6a0 legacy=0x7f622805bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 10 monclient: shutdown 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 1 -- 10.20.193.104:0/2748331007 >> v1:10.20.193.104:6790/0 conn(0x7f6258182010 legacy=0x7f6258171ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 1 -- 10.20.193.104:0/2748331007 shutdown_connections 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 1 -- 10.20.193.104:0/2748331007 >> 10.20.193.104:0/2748331007 conn(0x7f625808e860 msgr2=0x7f62580856d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 1 -- 10.20.193.104:0/2748331007 shutdown_connections 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 1 -- 10.20.193.104:0/2748331007 wait complete. 2026-02-13T08:06:12.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.707+0000 7f625f44e640 1 librados: shutdown 2026-02-13T08:06:12.724 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T08:06:12.724 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T08:06:12.724 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T08:06:12.793 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 10 monclient: get_monmap_and_config 2026-02-13T08:06:12.793 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 10 monclient: build_initial_monmap 2026-02-13T08:06:12.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 10 monclient: monmap: 2026-02-13T08:06:12.794 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:06:12.794 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.794 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:06:12.790834+0000 2026-02-13T08:06:12.794 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:06:12.790834+0000 2026-02-13T08:06:12.794 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:06:12.794 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.794 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:06:12.794 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:06:12.794 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:06:12.794 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 1 Processor -- start 2026-02-13T08:06:12.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 1 -- start start 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 10 monclient: init 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 10 monclient: _reopen_session rank -1 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 10 monclient(hunting): picked mon.noname-c con 0x7f454413f690 addr v1:10.20.193.119:6789/0 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 10 monclient(hunting): picked mon.noname-a con 0x7f454408d940 addr v1:10.20.193.104:6789/0 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 10 monclient(hunting): picked mon.noname-b con 0x7f454408dd60 addr v1:10.20.193.104:6790/0 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f454408b890 con 0x7f454408d940 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f454408bb70 con 0x7f454413f690 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4544089f10 con 0x7f454408dd60 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 10 monclient(hunting): _renew_subs 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4549fe4640 10 monclient(hunting): authenticate will time out at 478.379556s 2026-02-13T08:06:12.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45437fe640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f454413f690 legacy=0x7f454408d230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4543fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f454408dd60 0x7f45441a1c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:54018/0 (socket says 10.20.193.104:54018) 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f4543fff640 1 -- 10.20.193.104:0/180381722 learned_addr learned my addr 10.20.193.104:0/180381722 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 1 -- 10.20.193.104:0/180381722 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840360100 0 0) 0x7f4544089f10 con 0x7f454408dd60 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 10 monclient(hunting): my global_id is 4427 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 1 -- 10.20.193.104:0/180381722 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4528003620 con 0x7f454408dd60 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 1 -- 10.20.193.104:0/180381722 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2763126432 0 0) 0x7f454408b890 con 0x7f454408d940 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 10 monclient(hunting): my global_id is 4437 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.787+0000 7f45427fc640 1 -- 10.20.193.104:0/180381722 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4544089f10 con 0x7f454408d940 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 1 -- 10.20.193.104:0/180381722 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3458735482 0 0) 0x7f4528003620 con 0x7f454408dd60 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 1 -- 10.20.193.104:0/180381722 >> v1:10.20.193.119:6789/0 conn(0x7f454413f690 legacy=0x7f454408d230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 1 -- 10.20.193.104:0/180381722 >> v1:10.20.193.104:6789/0 conn(0x7f454408d940 legacy=0x7f4544180540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 10 monclient: _finish_hunting 0 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 1 monclient: found mon.noname-b 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 1 -- 10.20.193.104:0/180381722 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45441a63c0 con 0x7f454408dd60 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 10 monclient: _finish_auth 0 2026-02-13T08:06:12.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 10 monclient: _check_auth_tickets 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 1 -- 10.20.193.104:0/180381722 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4538003180 con 0x7f454408dd60 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 10 monclient: dump: 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.808 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 5 monclient: authenticate success, global_id 4427 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 1 -- 10.20.193.104:0/180381722 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4538003440 con 0x7f454408dd60 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 1 -- 10.20.193.104:0/180381722 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4538003880 con 0x7f454408dd60 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45427fc640 10 monclient: dump: 2026-02-13T08:06:12.809 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient: get_monmap_and_config success 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 4 set_mon_vals no callback set 2026-02-13T08:06:12.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient: shutdown 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- 10.20.193.104:0/180381722 >> v1:10.20.193.104:6790/0 conn(0x7f454408dd60 legacy=0x7f45441a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- 10.20.193.104:0/180381722 shutdown_connections 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- 10.20.193.104:0/180381722 >> 10.20.193.104:0/180381722 conn(0x7f4544051a50 msgr2=0x7f4544051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- 10.20.193.104:0/180381722 shutdown_connections 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- 10.20.193.104:0/180381722 wait complete. 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient: build_initial_monmap 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient: monmap: 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:06:12.811 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:06:12.812 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.812 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:06:12.812 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:06:12.812 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:06:12.812 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 librados: starting msgr at 2026-02-13T08:06:12.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 librados: starting objecter 2026-02-13T08:06:12.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 Processor -- start 2026-02-13T08:06:12.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- start start 2026-02-13T08:06:12.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 librados: setting wanted keys 2026-02-13T08:06:12.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 librados: calling monclient init 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient: init 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient: _reopen_session rank -1 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient(hunting): picked mon.noname-a con 0x7f454408d940 addr v1:10.20.193.104:6789/0 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient(hunting): picked mon.noname-b con 0x7f454408dd60 addr v1:10.20.193.119:6789/0 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient(hunting): picked mon.noname-c con 0x7f454413f690 addr v1:10.20.193.104:6790/0 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f454413cc20 con 0x7f454408d940 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4544129d90 con 0x7f454408dd60 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45441282d0 con 0x7f454413f690 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient(hunting): _renew_subs 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient(hunting): authenticate will time out at 478.382017s 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45437fe640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f454408d940 0x7f454413bc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:33100/0 (socket says 10.20.193.104:33100) 2026-02-13T08:06:12.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f45437fe640 1 -- 10.20.193.104:0/3513869482 learned_addr learned my addr 10.20.193.104:0/3513869482 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 client.?.objecter ms_handle_connect 0x7f454408d940 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 client.?.objecter ms_handle_connect 0x7f454413f690 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4542ffd640 1 -- 10.20.193.104:0/3513869482 >> v1:10.20.193.119:6789/0 conn(0x7f454408dd60 legacy=0x7f454418d820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2757132660 0 0) 0x7f454413cc20 con 0x7f454408d940 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): my global_id is 4440 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4514003620 con 0x7f454408d940 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395940190 0 0) 0x7f45441282d0 con 0x7f454413f690 2026-02-13T08:06:12.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): my global_id is 4430 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f454413cc20 con 0x7f454413f690 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1648611447 0 0) 0x7f4514003620 con 0x7f454408d940 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45441282d0 con 0x7f454408d940 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4530004230 con 0x7f454408d940 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): dump: 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.815 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2205187826 0 0) 0x7f454413cc20 con 0x7f454413f690 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4514003620 con 0x7f454413f690 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4538002fa0 con 0x7f454413f690 2026-02-13T08:06:12.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): dump: 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.817 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3427545726 0 0) 0x7f45441282d0 con 0x7f454408d940 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 >> v1:10.20.193.104:6790/0 conn(0x7f454413f690 legacy=0x7f454418ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 >> v1:10.20.193.119:6789/0 conn(0x7f454408dd60 legacy=0x7f454418d820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: _finish_hunting 0 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 monclient: found mon.a 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454412a630 con 0x7f454408d940 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: _finish_auth 0 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: _check_auth_tickets 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 5 monclient: authenticate success, global_id 4440 2026-02-13T08:06:12.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient: _renew_subs 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4544129a60 con 0x7f454408d940 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 client.4440.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient: _renew_subs 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f454413c370 con 0x7f454408d940 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 librados: init done 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4530004440 con 0x7f454408d940 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4530004850 con 0x7f454408d940 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: dump: 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.820 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4541ffb640 4 set_mon_vals no callback set 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4549fe4640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f454413c6b0 con 0x7f45441a35a0 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f4530004a70 con 0x7f454408d940 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 client.4440.objecter ms_handle_connect 0x7f45441a35a0 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 client.4440.objecter resend_mon_ops 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f453004a190 con 0x7f454408d940 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 client.4440.objecter ms_dispatch2 0x7f4544000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 3 client.4440.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 3 client.4440.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 20 client.4440.objecter dump_active .. 0 homeless 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1516143020 0 0) 0x7f454413c6b0 con 0x7f45441a35a0 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient(hunting): my global_id is 4443 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45441282d0 con 0x7f45441a35a0 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 413714902 0 0) 0x7f45441282d0 con 0x7f45441a35a0 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f454413c6b0 con 0x7f45441a35a0 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f45340041b0 con 0x7f45441a35a0 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: dump: 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.822 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f4543fff640 10 monclient: get_auth_request con 0x7f451403b840 auth_method 0 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1232491216 0 0) 0x7f454413c6b0 con 0x7f45441a35a0 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f454412a200 con 0x7f45441a35a0 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 client.4440.objecter ms_handle_connect 0x7f451403b840 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f45340041b0 con 0x7f45441a35a0 2026-02-13T08:06:12.823 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 >> v1:10.20.193.104:6789/0 conn(0x7f45441a35a0 legacy=0x7f4544086830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.791+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 >> v1:10.20.193.104:6789/0 conn(0x7f45441a35a0 legacy=0x7f4544086830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4544087650 con 0x7f4544127820 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 10 client.4440.objecter ms_handle_connect 0x7f4544127820 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 10 client.4440.objecter resend_mon_ops 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165934481 0 0) 0x7f4544087650 con 0x7f4544127820 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 10 monclient(hunting): my global_id is 4446 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f454413c6b0 con 0x7f4544127820 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 308515009 0 0) 0x7f454413c6b0 con 0x7f4544127820 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4544087650 con 0x7f4544127820 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4534006910 con 0x7f4544127820 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 10 monclient: dump: 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.825 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 57126548 0 0) 0x7f4544087650 con 0x7f4544127820 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 --> v1:10.20.193.104:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4544194810 con 0x7f4544127820 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4315 (unknown 0 0 4188382609) 0x7f4534006970 con 0x7f4544127820 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 >> v1:10.20.193.104:6789/0 conn(0x7f4544127820 legacy=0x7f4544086f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.826 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f451ffff640 1 -- 10.20.193.104:0/3513869482 >> v1:10.20.193.104:6789/0 conn(0x7f4544127820 legacy=0x7f4544086f40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:06:12.827 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:06:12.827 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:06:12.827 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:06:12.827 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:06:12.827 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 12, 2026-02-13T08:06:12.827 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 42206, 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:06:12.828 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:06:12.829 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:06:12.830 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:06:12.831 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:06:12.832 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:06:12.833 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.834 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:06:12.835 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:06:12.836 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: "num": 2 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: "num": 4 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.837 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:06:12.838 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:06:12.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 10 librados: watch_flush enter 2026-02-13T08:06:12.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 10 librados: watch_flush exit 2026-02-13T08:06:12.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 20 client.4440.objecter shutdown clearing up homeless session... 2026-02-13T08:06:12.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 10 client.4440.objecter successfully canceled tick 2026-02-13T08:06:12.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 1 -- 10.20.193.104:0/3513869482 >> v1:10.20.193.119:6812/276487904 conn(0x7f451403b840 legacy=0x7f451405bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 10 monclient: shutdown 2026-02-13T08:06:12.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:06:12.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 1 -- 10.20.193.104:0/3513869482 >> v1:10.20.193.104:6789/0 conn(0x7f454408d940 legacy=0x7f454413bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4543fff640 1 -- 10.20.193.104:0/3513869482 reap_dead start 2026-02-13T08:06:12.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4543fff640 1 -- 10.20.193.104:0/3513869482 reap_dead start 2026-02-13T08:06:12.840 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 1 -- 10.20.193.104:0/3513869482 shutdown_connections 2026-02-13T08:06:12.840 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 1 -- 10.20.193.104:0/3513869482 >> 10.20.193.104:0/3513869482 conn(0x7f4544051a50 msgr2=0x7f454405ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:06:12.840 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 1 -- 10.20.193.104:0/3513869482 shutdown_connections 2026-02-13T08:06:12.840 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 1 -- 10.20.193.104:0/3513869482 wait complete. 2026-02-13T08:06:12.840 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.795+0000 7f4549fe4640 1 librados: shutdown 2026-02-13T08:06:12.840 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T08:06:12.840 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T08:06:12.840 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T08:06:12.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 10 monclient: get_monmap_and_config 2026-02-13T08:06:12.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 10 monclient: build_initial_monmap 2026-02-13T08:06:12.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 10 monclient: monmap: 2026-02-13T08:06:12.901 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:06:12.901 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.901 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:06:12.898800+0000 2026-02-13T08:06:12.901 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:06:12.898800+0000 2026-02-13T08:06:12.901 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:06:12.902 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.902 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:06:12.902 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:06:12.902 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:06:12.902 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 1 Processor -- start 2026-02-13T08:06:12.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 1 -- start start 2026-02-13T08:06:12.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 10 monclient: init 2026-02-13T08:06:12.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 10 monclient: _reopen_session rank -1 2026-02-13T08:06:12.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:06:12.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 10 monclient(hunting): picked mon.noname-a con 0x7f54c0139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:06:12.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 10 monclient(hunting): picked mon.noname-b con 0x7f54c015e200 addr v1:10.20.193.104:6790/0 2026-02-13T08:06:12.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 10 monclient(hunting): picked mon.noname-c con 0x7f54c017fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c013aa00 con 0x7f54c0139f20 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c008ba20 con 0x7f54c017fd00 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c0089e30 con 0x7f54c015e200 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 10 monclient(hunting): _renew_subs 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c753f640 10 monclient(hunting): authenticate will time out at 478.487864s 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c5ab5640 1 -- >> v1:10.20.193.119:6789/0 conn(0x7f54c017fd00 legacy=0x7f54c01a00e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c52b4640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f54c0139f20 0x7f54c013a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:33126/0 (socket says 10.20.193.104:33126) 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c52b4640 1 -- 10.20.193.104:0/57574201 learned_addr learned my addr 10.20.193.104:0/57574201 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.895+0000 7f54c4ab3640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f54c015e200 0x7f54c017e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:54034/0 (socket says 10.20.193.104:54034) 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 -- 10.20.193.104:0/57574201 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1313969202 0 0) 0x7f54b0002920 con 0x7f54c0139f20 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient(hunting): my global_id is 4449 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 -- 10.20.193.104:0/57574201 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54a8003620 con 0x7f54c0139f20 2026-02-13T08:06:12.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 -- 10.20.193.104:0/57574201 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 190202762 0 0) 0x7f54c0089e30 con 0x7f54c015e200 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient(hunting): my global_id is 4433 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 -- 10.20.193.104:0/57574201 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54b0002920 con 0x7f54c015e200 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 -- 10.20.193.104:0/57574201 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2921882747 0 0) 0x7f54a8003620 con 0x7f54c0139f20 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 -- 10.20.193.104:0/57574201 >> v1:10.20.193.104:6790/0 conn(0x7f54c015e200 legacy=0x7f54c017e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 -- 10.20.193.104:0/57574201 >> v1:10.20.193.119:6789/0 conn(0x7f54c017fd00 legacy=0x7f54c01a00e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient: _finish_hunting 0 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 monclient: found mon.noname-a 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 -- 10.20.193.104:0/57574201 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c008a380 con 0x7f54c0139f20 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient: _finish_auth 0 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient: _check_auth_tickets 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:06:12.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 -- 10.20.193.104:0/57574201 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f54b0002fd0 con 0x7f54c0139f20 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient: dump: 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 5 monclient: authenticate success, global_id 4449 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:06:12.911 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 -- 10.20.193.104:0/57574201 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54b0003260 con 0x7f54c0139f20 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 1 -- 10.20.193.104:0/57574201 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f54b00049a0 con 0x7f54c0139f20 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54affff640 10 monclient: dump: 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient: get_monmap_and_config success 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 4 set_mon_vals no callback set 2026-02-13T08:06:12.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient: shutdown 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- 10.20.193.104:0/57574201 >> v1:10.20.193.104:6789/0 conn(0x7f54c0139f20 legacy=0x7f54c013a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- 10.20.193.104:0/57574201 shutdown_connections 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- 10.20.193.104:0/57574201 >> 10.20.193.104:0/57574201 conn(0x7f54c0051a50 msgr2=0x7f54c0051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- 10.20.193.104:0/57574201 shutdown_connections 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- 10.20.193.104:0/57574201 wait complete. 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient: build_initial_monmap 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient: monmap: 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:06:12.913 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 librados: starting msgr at 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 librados: starting objecter 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 Processor -- start 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- start start 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 librados: setting wanted keys 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 librados: calling monclient init 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient: init 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient: _reopen_session rank -1 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient(hunting): picked mon.noname-a con 0x7f54c0139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient(hunting): picked mon.noname-c con 0x7f54c015e200 addr v1:10.20.193.104:6790/0 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient(hunting): picked mon.noname-b con 0x7f54c017fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c017ecf0 con 0x7f54c0139f20 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c0086620 con 0x7f54c017fd00 2026-02-13T08:06:12.914 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c0163fe0 con 0x7f54c015e200 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient(hunting): _renew_subs 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient(hunting): authenticate will time out at 478.489752s 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c52b4640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f54c0139f20 0x7f54c017ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:33128/0 (socket says 10.20.193.104:33128) 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c52b4640 1 -- 10.20.193.104:0/2497726793 learned_addr learned my addr 10.20.193.104:0/2497726793 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c4ab3640 1 --1- 10.20.193.104:0/2497726793 >> v1:10.20.193.104:6790/0 conn(0x7f54c015e200 0x7f54c017e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:54036/0 (socket says 10.20.193.104:54036) 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c5ab5640 1 -- 10.20.193.104:0/2497726793 >> v1:10.20.193.119:6789/0 conn(0x7f54c017fd00 legacy=0x7f54c0127ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 client.?.objecter ms_handle_connect 0x7f54c0139f20 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 client.?.objecter ms_handle_connect 0x7f54c015e200 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417346833 0 0) 0x7f54c017ecf0 con 0x7f54c0139f20 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): my global_id is 4452 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5490003620 con 0x7f54c0139f20 2026-02-13T08:06:12.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310179601 0 0) 0x7f54c0163fe0 con 0x7f54c015e200 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): my global_id is 4436 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c017ecf0 con 0x7f54c015e200 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2365572954 0 0) 0x7f54c017ecf0 con 0x7f54c015e200 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54c0163fe0 con 0x7f54c015e200 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f54b4003040 con 0x7f54c015e200 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): dump: 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.916 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3676700609 0 0) 0x7f5490003620 con 0x7f54c0139f20 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54c017ecf0 con 0x7f54c0139f20 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f54b0003410 con 0x7f54c0139f20 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): dump: 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.917 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1360093147 0 0) 0x7f54c0163fe0 con 0x7f54c015e200 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 >> v1:10.20.193.119:6789/0 conn(0x7f54c017fd00 legacy=0x7f54c0127ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 >> v1:10.20.193.104:6789/0 conn(0x7f54c0139f20 legacy=0x7f54c017ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: _finish_hunting 0 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 monclient: found mon.c 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c0162af0 con 0x7f54c015e200 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: _finish_auth 0 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: _check_auth_tickets 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 5 monclient: authenticate success, global_id 4436 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient: _renew_subs 2026-02-13T08:06:12.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f54c0164e50 con 0x7f54c015e200 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 client.4436.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient: _renew_subs 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f54c01638b0 con 0x7f54c015e200 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 librados: init done 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54b40048e0 con 0x7f54c015e200 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f54b4004cf0 con 0x7f54c015e200 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54af7fe640 4 set_mon_vals no callback set 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: dump: 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.919 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c753f640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f54c0061860 con 0x7f54c017f840 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 client.4436.objecter ms_handle_connect 0x7f54c017f840 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 client.4436.objecter resend_mon_ops 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1964865126 0 0) 0x7f54c0061860 con 0x7f54c017f840 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient(hunting): my global_id is 4439 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c0163fe0 con 0x7f54c017f840 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3001457266 0 0) 0x7f54c0163fe0 con 0x7f54c017f840 2026-02-13T08:06:12.920 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54c0061860 con 0x7f54c017f840 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f54b0004e40 con 0x7f54c017f840 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: dump: 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f54b4010d00 con 0x7f54c015e200 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7f54b404a080 con 0x7f54c015e200 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 client.4436.objecter ms_dispatch2 0x7f54c0000ba0 osd_map(19..19 src has 1..19) 2026-02-13T08:06:12.921 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 3 client.4436.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:06:12.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 3 client.4436.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:06:12.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 20 client.4436.objecter dump_active .. 0 homeless 2026-02-13T08:06:12.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2312939057 0 0) 0x7f54c0061860 con 0x7f54c017f840 2026-02-13T08:06:12.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54c0088e20 con 0x7f54c017f840 2026-02-13T08:06:12.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54c5ab5640 10 monclient: get_auth_request con 0x7f549003b940 auth_method 0 2026-02-13T08:06:12.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f54b0005070 con 0x7f54c017f840 2026-02-13T08:06:12.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:06:12.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:06:12.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 >> v1:10.20.193.104:6790/0 conn(0x7f54c017f840 legacy=0x7f54c013bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 >> v1:10.20.193.104:6790/0 conn(0x7f54c017f840 legacy=0x7f54c013bbf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:06:12.922 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.899+0000 7f54adffb640 10 client.4436.objecter ms_handle_connect 0x7f549003b940 2026-02-13T08:06:12.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f54c013c700 con 0x7f54c013c300 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 10 client.4436.objecter ms_handle_connect 0x7f54c013c300 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 10 client.4436.objecter resend_mon_ops 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537060093 0 0) 0x7f54c013c700 con 0x7f54c013c300 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 10 monclient(hunting): _negotiate 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 10 monclient(hunting): my global_id is 4442 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54c0061860 con 0x7f54c013c300 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 105173465 0 0) 0x7f54c0061860 con 0x7f54c013c300 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54c013c700 con 0x7f54c013c300 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f54b00056f0 con 0x7f54c013c300 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 10 monclient: dump: 2026-02-13T08:06:12.924 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2874446631 0 0) 0x7f54c013c700 con 0x7f54c013c300 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 --> v1:10.20.193.104:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f54c013c8d0 con 0x7f54c013c300 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4480 (unknown 0 0 2089101097) 0x7f54b0005800 con 0x7f54c013c300 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 >> v1:10.20.193.104:6790/0 conn(0x7f54c013c300 legacy=0x7f54c012a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54adffb640 1 -- 10.20.193.104:0/2497726793 >> v1:10.20.193.104:6790/0 conn(0x7f54c013c300 legacy=0x7f54c012a1e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 12, 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 42310, 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:06:12.926 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:06:12.927 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:06:12.928 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:06:12.929 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.930 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.931 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:06:12.932 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.933 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: "num": 4 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.934 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: "num": 4 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:06:12.935 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 10 librados: watch_flush enter 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 10 librados: watch_flush exit 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 20 client.4436.objecter shutdown clearing up homeless session... 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 10 client.4436.objecter successfully canceled tick 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 1 -- 10.20.193.104:0/2497726793 >> v1:10.20.193.119:6812/276487904 conn(0x7f549003b940 legacy=0x7f549005bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 10 monclient: shutdown 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 1 -- 10.20.193.104:0/2497726793 >> v1:10.20.193.104:6790/0 conn(0x7f54c015e200 legacy=0x7f54c017e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c5ab5640 1 -- 10.20.193.104:0/2497726793 reap_dead start 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c5ab5640 1 -- 10.20.193.104:0/2497726793 reap_dead start 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 1 -- 10.20.193.104:0/2497726793 shutdown_connections 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 1 -- 10.20.193.104:0/2497726793 >> 10.20.193.104:0/2497726793 conn(0x7f54c0051a50 msgr2=0x7f54c005bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 1 -- 10.20.193.104:0/2497726793 shutdown_connections 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 1 -- 10.20.193.104:0/2497726793 wait complete. 2026-02-13T08:06:12.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:06:12.903+0000 7f54c753f640 1 librados: shutdown 2026-02-13T08:06:12.938 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T08:06:12.938 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T08:06:14.329 INFO:tasks.workunit.client.0.trial119.stderr:Note: switching to '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'. 2026-02-13T08:06:14.329 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-13T08:06:14.329 INFO:tasks.workunit.client.0.trial119.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-13T08:06:14.329 INFO:tasks.workunit.client.0.trial119.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-13T08:06:14.329 INFO:tasks.workunit.client.0.trial119.stderr:state without impacting any branches by switching back to a branch. 2026-02-13T08:06:14.329 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-13T08:06:14.329 INFO:tasks.workunit.client.0.trial119.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-13T08:06:14.330 INFO:tasks.workunit.client.0.trial119.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-13T08:06:14.330 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-13T08:06:14.330 INFO:tasks.workunit.client.0.trial119.stderr: git switch -c 2026-02-13T08:06:14.330 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-13T08:06:14.330 INFO:tasks.workunit.client.0.trial119.stderr:Or undo this operation with: 2026-02-13T08:06:14.330 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-13T08:06:14.330 INFO:tasks.workunit.client.0.trial119.stderr: git switch - 2026-02-13T08:06:14.330 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-13T08:06:14.330 INFO:tasks.workunit.client.0.trial119.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-13T08:06:14.330 INFO:tasks.workunit.client.0.trial119.stderr: 2026-02-13T08:06:14.330 INFO:tasks.workunit.client.0.trial119.stderr:HEAD is now at 3b40640f18f Merge branch 'wip-74888-tentacle' of https://github.com/aainscow/ceph into wip-bharath17-testing-2026-02-12-0618-tentacle 2026-02-13T08:06:14.338 DEBUG:teuthology.orchestra.run.trial119:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-13T08:06:14.344 INFO:tasks.workunit.client.0.trial119.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-13T08:06:14.345 INFO:tasks.workunit.client.0.trial119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-13T08:06:14.345 INFO:tasks.workunit.client.0.trial119.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-13T08:06:14.443 INFO:tasks.workunit.client.0.trial119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-13T08:06:14.475 INFO:tasks.workunit.client.0.trial119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-13T08:06:14.500 INFO:tasks.workunit.client.0.trial119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-13T08:06:14.501 INFO:tasks.workunit.client.0.trial119.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-13T08:06:14.501 INFO:tasks.workunit.client.0.trial119.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-13T08:06:14.524 INFO:tasks.workunit.client.0.trial119.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-13T08:06:14.527 DEBUG:teuthology.orchestra.run.trial119:> set -ex 2026-02-13T08:06:14.527 DEBUG:teuthology.orchestra.run.trial119:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-13T08:06:14.573 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2026-02-13T08:06:14.576 INFO:tasks.workunit:Running workunit rados/test.sh... 2026-02-13T08:06:14.576 DEBUG:teuthology.orchestra.run.trial119:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2026-02-13T08:06:14.624 INFO:tasks.workunit.client.0.trial119.stderr:+ parallel=1 2026-02-13T08:06:14.624 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' '' = --serial ']' 2026-02-13T08:06:14.624 INFO:tasks.workunit.client.0.trial119.stderr:+ crimson=0 2026-02-13T08:06:14.624 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' '' = --crimson ']' 2026-02-13T08:06:14.625 INFO:tasks.workunit.client.0.trial119.stderr:+ color= 2026-02-13T08:06:14.625 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -t 1 ']' 2026-02-13T08:06:14.625 INFO:tasks.workunit.client.0.trial119.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2026-02-13T08:06:14.625 INFO:tasks.workunit.client.0.trial119.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-13T08:06:14.625 INFO:tasks.workunit.client.0.trial119.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2026-02-13T08:06:14.626 INFO:tasks.workunit.client.0.trial119.stderr:+ declare -A pids 2026-02-13T08:06:14.626 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.626 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.626 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_aio 2026-02-13T08:06:14.626 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_aio' 2026-02-13T08:06:14.627 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_aio 2026-02-13T08:06:14.627 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.628 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_aio 2026-02-13T08:06:14.628 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14085 2026-02-13T08:06:14.628 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_aio on pid 14085' 2026-02-13T08:06:14.629 INFO:tasks.workunit.client.0.trial119.stdout:test api_aio on pid 14085 2026-02-13T08:06:14.630 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14085 2026-02-13T08:06:14.630 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.630 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.630 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2026-02-13T08:06:14.630 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_aio_pp 2026-02-13T08:06:14.630 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_aio_pp' 2026-02-13T08:06:14.631 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_aio_pp 2026-02-13T08:06:14.631 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.631 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.631 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.631 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.631 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.631 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio.xml 2026-02-13T08:06:14.631 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_aio.log 2026-02-13T08:06:14.631 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_aio: /' 2026-02-13T08:06:14.632 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_aio_pp 2026-02-13T08:06:14.632 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14093 2026-02-13T08:06:14.632 INFO:tasks.workunit.client.0.trial119.stdout:test api_aio_pp on pid 14093 2026-02-13T08:06:14.634 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_aio_pp on pid 14093' 2026-02-13T08:06:14.634 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14093 2026-02-13T08:06:14.634 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.634 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.634 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2026-02-13T08:06:14.634 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_io 2026-02-13T08:06:14.634 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_io' 2026-02-13T08:06:14.634 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_io 2026-02-13T08:06:14.634 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.635 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.635 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.635 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.635 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.635 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_aio_pp.xml 2026-02-13T08:06:14.635 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_aio_pp.log 2026-02-13T08:06:14.635 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_aio_pp: /' 2026-02-13T08:06:14.635 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_io 2026-02-13T08:06:14.635 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14101 2026-02-13T08:06:14.635 INFO:tasks.workunit.client.0.trial119.stdout:test api_io on pid 14101 2026-02-13T08:06:14.637 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_io on pid 14101' 2026-02-13T08:06:14.637 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14101 2026-02-13T08:06:14.637 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_io_pp 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_io_pp' 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_io_pp 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io.xml 2026-02-13T08:06:14.638 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_io.log 2026-02-13T08:06:14.639 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_io: /' 2026-02-13T08:06:14.639 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_io_pp 2026-02-13T08:06:14.639 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14109 2026-02-13T08:06:14.639 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_io_pp on pid 14109' 2026-02-13T08:06:14.639 INFO:tasks.workunit.client.0.trial119.stdout:test api_io_pp on pid 14109 2026-02-13T08:06:14.641 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14109 2026-02-13T08:06:14.641 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.641 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.641 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2026-02-13T08:06:14.641 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_asio 2026-02-13T08:06:14.641 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_asio' 2026-02-13T08:06:14.641 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_asio 2026-02-13T08:06:14.641 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.641 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.642 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.642 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.642 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.642 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_io_pp.xml 2026-02-13T08:06:14.642 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_io_pp.log 2026-02-13T08:06:14.642 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_io_pp: /' 2026-02-13T08:06:14.642 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_asio 2026-02-13T08:06:14.642 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14117 2026-02-13T08:06:14.642 INFO:tasks.workunit.client.0.trial119.stdout:test api_asio on pid 14117 2026-02-13T08:06:14.644 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_asio on pid 14117' 2026-02-13T08:06:14.644 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14117 2026-02-13T08:06:14.644 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.644 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.644 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2026-02-13T08:06:14.644 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_list 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_list' 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_list 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_asio.xml 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_asio.log 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_asio: /' 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_list 2026-02-13T08:06:14.645 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14125 2026-02-13T08:06:14.646 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_list on pid 14125' 2026-02-13T08:06:14.646 INFO:tasks.workunit.client.0.trial119.stdout:test api_list on pid 14125 2026-02-13T08:06:14.648 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14125 2026-02-13T08:06:14.648 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.648 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.648 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2026-02-13T08:06:14.648 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_lock 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_lock' 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_lock 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_list.xml 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_list.log 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_list: /' 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_lock 2026-02-13T08:06:14.649 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14140 2026-02-13T08:06:14.650 INFO:tasks.workunit.client.0.trial119.stdout:test api_lock on pid 14140 2026-02-13T08:06:14.651 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_lock on pid 14140' 2026-02-13T08:06:14.651 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14140 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_lock_pp 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_lock_pp' 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_lock_pp 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.652 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock.xml 2026-02-13T08:06:14.653 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_lock.log 2026-02-13T08:06:14.653 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_lock: /' 2026-02-13T08:06:14.653 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_lock_pp 2026-02-13T08:06:14.653 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14162 2026-02-13T08:06:14.653 INFO:tasks.workunit.client.0.trial119.stdout:test api_lock_pp on pid 14162 2026-02-13T08:06:14.655 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_lock_pp on pid 14162' 2026-02-13T08:06:14.655 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14162 2026-02-13T08:06:14.655 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.655 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.655 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2026-02-13T08:06:14.655 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_misc 2026-02-13T08:06:14.655 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_misc' 2026-02-13T08:06:14.655 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.655 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.655 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.656 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.656 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_lock_pp.xml 2026-02-13T08:06:14.656 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_misc 2026-02-13T08:06:14.656 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_lock_pp.log 2026-02-13T08:06:14.656 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.656 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_lock_pp: /' 2026-02-13T08:06:14.656 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_misc 2026-02-13T08:06:14.656 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14186 2026-02-13T08:06:14.656 INFO:tasks.workunit.client.0.trial119.stdout:test api_misc on pid 14186 2026-02-13T08:06:14.658 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_misc on pid 14186' 2026-02-13T08:06:14.658 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14186 2026-02-13T08:06:14.658 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.658 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.658 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2026-02-13T08:06:14.658 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_misc_pp 2026-02-13T08:06:14.658 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_misc_pp' 2026-02-13T08:06:14.658 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_misc_pp 2026-02-13T08:06:14.658 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.659 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.659 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.659 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.659 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.659 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc.xml 2026-02-13T08:06:14.659 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_misc.log 2026-02-13T08:06:14.659 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_misc: /' 2026-02-13T08:06:14.659 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_misc_pp 2026-02-13T08:06:14.659 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14210 2026-02-13T08:06:14.659 INFO:tasks.workunit.client.0.trial119.stdout:test api_misc_pp on pid 14210 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_misc_pp on pid 14210' 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14210 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_pool 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_pool' 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_pool 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.661 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.662 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_misc_pp.xml 2026-02-13T08:06:14.662 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_misc_pp.log 2026-02-13T08:06:14.662 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_misc_pp: /' 2026-02-13T08:06:14.662 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_pool 2026-02-13T08:06:14.662 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14227 2026-02-13T08:06:14.662 INFO:tasks.workunit.client.0.trial119.stdout:test api_pool on pid 14227 2026-02-13T08:06:14.663 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_pool on pid 14227' 2026-02-13T08:06:14.663 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14227 2026-02-13T08:06:14.663 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_snapshots 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_snapshots' 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_snapshots 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_pool.xml 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_pool.log 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_pool: /' 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_snapshots 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14248 2026-02-13T08:06:14.664 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_snapshots on pid 14248' 2026-02-13T08:06:14.665 INFO:tasks.workunit.client.0.trial119.stdout:test api_snapshots on pid 14248 2026-02-13T08:06:14.666 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14248 2026-02-13T08:06:14.666 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.666 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.666 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2026-02-13T08:06:14.666 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_snapshots_pp 2026-02-13T08:06:14.666 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_snapshots_pp' 2026-02-13T08:06:14.666 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_snapshots_pp 2026-02-13T08:06:14.666 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.666 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.667 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.667 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.667 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.667 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots.xml 2026-02-13T08:06:14.667 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_snapshots.log 2026-02-13T08:06:14.667 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_snapshots: /' 2026-02-13T08:06:14.667 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [==========] Running 29 tests from 1 test suite. 2026-02-13T08:06:14.667 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [----------] Global test environment set-up. 2026-02-13T08:06:14.667 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [----------] 29 tests from AsioRados 2026-02-13T08:06:14.667 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 10 monclient: get_monmap_and_config 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 10 monclient: build_initial_monmap 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 10 monclient: monmap: 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: epoch 0 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: last_changed 0.000000 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: created 0.000000 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: election_strategy: 1 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 1 Processor -- start 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 1 -- start start 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 10 monclient: init 2026-02-13T08:06:14.668 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 10 monclient: _reopen_session rank -1 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 10 monclient(hunting): picked mon.noname-b con 0x5617efd7e1e0 addr v1:10.20.193.119:6789/0 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 10 monclient(hunting): picked mon.noname-c con 0x5617efe8f290 addr v1:10.20.193.104:6790/0 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 10 monclient(hunting): picked mon.noname-a con 0x5617efe15b90 addr v1:10.20.193.104:6789/0 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5617efd988e0 con 0x5617efe15b90 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5617efe34fe0 con 0x5617efd7e1e0 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5617efe318c0 con 0x5617efe8f290 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 10 monclient(hunting): _renew_subs 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3438dd980 10 monclient(hunting): authenticate will time out at 483.559883s 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.742+0000 7fd3413b2640 1 -- >> v1:10.20.193.119:6789/0 conn(0x5617efd7e1e0 legacy=0x5617efe344d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd340bb1640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x5617efe8f290 0x5617efe774e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.119:56700/0 (socket says 10.20.193.119:56700) 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd340bb1640 1 -- 10.20.193.119:0/68853798 learned_addr learned my addr 10.20.193.119:0/68853798 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd341bb3640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x5617efe15b90 0x5617efe78c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.119:55668/0 (socket says 10.20.193.119:55668) 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 1 -- 10.20.193.119:0/68853798 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583243833 0 0) 0x5617efe318c0 con 0x5617efe8f290 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient(hunting): _negotiate 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:14.669 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient(hunting): my global_id is 4472 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 1 -- 10.20.193.119:0/68853798 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd320001e20 con 0x5617efe8f290 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 1 -- 10.20.193.119:0/68853798 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1926466664 0 0) 0x7fd320001e20 con 0x5617efe8f290 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 1 -- 10.20.193.119:0/68853798 >> v1:10.20.193.119:6789/0 conn(0x5617efd7e1e0 legacy=0x5617efe344d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 1 -- 10.20.193.119:0/68853798 >> v1:10.20.193.104:6789/0 conn(0x5617efe15b90 legacy=0x5617efe78c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient: _finish_hunting 0 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 1 monclient: found mon.noname-c 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.104:6790/0 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 1 -- 10.20.193.119:0/68853798 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617efe31a90 con 0x5617efe8f290 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient: _finish_auth 0 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient: _check_auth_tickets 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 1 -- 10.20.193.119:0/68853798 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd32c0015c0 con 0x5617efe8f290 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:06:14.670 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient: dump: 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: epoch 1 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: election_strategy: 1 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 5 monclient: authenticate success, global_id 4472 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 1 -- 10.20.193.119:0/68853798 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd32c0017f0 con 0x5617efe8f290 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:06:14.671 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_snapshots_pp 2026-02-13T08:06:14.672 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14266 2026-02-13T08:06:14.672 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-test api_snapshots_pp on pid 14266 2026-02-13T08:06:14.672 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_snapshots_pp on pid 14266' 2026-02-13T08:06:14.672 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14266 2026-02-13T08:06:14.672 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.672 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout:13T08:06:14.746+0000 7fd3337fe640 1 -- 10.20.193.119:0/68853798 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd32c001c00 con 0x5617efe8f290 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: get_monmap_and_config success 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 4 set_mon_vals no callback set 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 10 monclient: dump: 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: epoch 1 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: election_strategy: 1 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:14.673 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: shutdown 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- 10.20.193.119:0/68853798 >> v1:10.20.193.104:6790/0 conn(0x5617efe8f290 legacy=0x5617efe774e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- 10.20.193.119:0/68853798 shutdown_connections 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- 10.20.193.119:0/68853798 >> 10.20.193.119:0/68853798 conn(0x5617efd9c3e0 msgr2=0x5617efd967d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- 10.20.193.119:0/68853798 shutdown_connections 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- 10.20.193.119:0/68853798 wait complete. 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: build_initial_monmap 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: monmap: 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: epoch 0 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: last_changed 0.000000 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: created 0.000000 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: min_mon_release 0 (unknown) 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: election_strategy: 1 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:06:14.674 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 librados: starting msgr at 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 librados: starting objecter 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 Processor -- start 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- start start 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 librados: setting wanted keys 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 librados: calling monclient init 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: init 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: _reopen_session rank -1 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient(hunting): picked mon.noname-c con 0x5617efd7e1e0 addr v1:10.20.193.104:6790/0 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_stat 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_stat' 2026-02-13T08:06:14.675 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_stat 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient(hunting): picked mon.noname-b con 0x5617efe15b90 addr v1:10.20.193.119:6789/0 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient(hunting): picked mon.noname-a con 0x5617efe8f290 addr v1:10.20.193.104:6789/0 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5617efe5f5a0 con 0x5617efe8f290 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5617efe1c150 con 0x5617efe15b90 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x5617efd96460 con 0x5617efd7e1e0 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient(hunting): _renew_subs 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient(hunting): authenticate will time out at 483.561482s 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd340bb1640 1 -- >> v1:10.20.193.119:6789/0 conn(0x5617efe15b90 legacy=0x5617efe7f990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.119:6789/0 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3413b2640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x5617efd7e1e0 0x5617efe30d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.119:56710/0 (socket says 10.20.193.119:56710) 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3413b2640 1 -- 10.20.193.119:0/3608333172 learned_addr learned my addr 10.20.193.119:0/3608333172 (peer_addr_for_me v1:10.20.193.119:0/0) 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 client.?.objecter ms_handle_connect 0x5617efd7e1e0 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1981320233 0 0) 0x5617efd96460 con 0x5617efd7e1e0 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient(hunting): _negotiate 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:06:14.676 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient(hunting): my global_id is 4475 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd320001b40 con 0x5617efd7e1e0 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 client.?.objecter ms_handle_connect 0x5617efe8f290 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3821318962 0 0) 0x7fd320001b40 con 0x5617efd7e1e0 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x5617efd96460 con 0x5617efd7e1e0 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd338001460 con 0x5617efd7e1e0 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.677 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient(hunting): dump: 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: epoch 1 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: election_strategy: 1 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 842401928 0 0) 0x5617efd96460 con 0x5617efd7e1e0 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 >> v1:10.20.193.119:6789/0 conn(0x5617efe15b90 legacy=0x5617efe7f990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 >> v1:10.20.193.104:6789/0 conn(0x5617efe8f290 legacy=0x5617efe810b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient: _finish_hunting 0 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 monclient: found mon.c 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617efe342c0 con 0x5617efd7e1e0 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient: _finish_auth 0 2026-02-13T08:06:14.678 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient: _check_auth_tickets 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 5 monclient: authenticate success, global_id 4475 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: _renew_subs 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x5617efe1c6b0 con 0x5617efd7e1e0 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 client.4475.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: _renew_subs 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x5617efe1afb0 con 0x5617efd7e1e0 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 librados: init done 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 librados: wait_for_osdmap waiting 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd338003450 con 0x5617efd7e1e0 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_snapshots_pp.xml 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2026-02-13T08:06:14.679 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_snapshots_pp: /' 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_stat 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14283 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+000test api_stat on pid 14283 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_stat on pid 14283' 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14283 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stdout:0 7fd3327fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd338003600 con 0x5617efd7e1e0 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient: dump: 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: epoch 1 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:14.680 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: min_mon_release 20 (tentacle) 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: election_strategy: 1 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3337fe640 4 set_mon_vals no callback set 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fd33800f610 con 0x5617efd7e1e0 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (unknown 2639841426 0 0) 0x7fd338048ad0 con 0x5617efd7e1e0 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_map(19..19 src has 1..19) 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 3 client.4475.objecter handle_osd_map got epochs [19,19] > 0 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 3 client.4475.objecter handle_osd_map decoding full epoch 19 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 20 client.4475.objecter dump_active .. 0 homeless 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 librados: wait_for_osdmap done waiting 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.104:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x5617efd2d200 con 0x5617efd7e1e0 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd340bb1640 10 monclient: get_auth_request con 0x7fd32003a050 auth_method 0 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (unknown 4138596325 0 0) 0x7fd3380112a0 con 0x5617efd7e1e0 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 monclient: handle_get_version_reply finishing 1 version 19 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd332ffd640 10 client.4475.objecter _get_latest_version latest 19, have it 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 client.4475.objecter create_pool name=ceph_test_rados_api_asio 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 client.4475.objecter pool_op_submit 1 2026-02-13T08:06:14.681 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:14.682 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.104:6790/0 -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x5617efcb2060 con 0x5617efd7e1e0 2026-02-13T08:06:14.682 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.682 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.682 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2026-02-13T08:06:14.682 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_stat_pp 2026-02-13T08:06:14.682 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_stat_pp' 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_stat_pp 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat.xml 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_stat.log 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_stat: /' 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_stat_pp 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14317 2026-02-13T08:06:14.683 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:14.746+0000 7fd3327fc640 10 client.4475.obtest api_stat_pp on pid 14317 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_stat_pp on pid 14317' 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14317 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_watch_notify 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_watch_notify' 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_watch_notify 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_stat_pp.xml 2026-02-13T08:06:14.684 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_stat_pp.log 2026-02-13T08:06:14.685 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_stat_pp: /' 2026-02-13T08:06:14.685 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_watch_notify 2026-02-13T08:06:14.685 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14345 2026-02-13T08:06:14.685 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_watch_notify on pid 14345' 2026-02-13T08:06:14.685 INFO:tasks.workunit.client.0.trial119.stdout:test api_watch_notify on pid 14345 2026-02-13T08:06:14.685 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14345 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_watch_notify_pp 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_watch_notify_pp' 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_watch_notify_pp 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify.xml 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_watch_notify.log 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_watch_notify: /' 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_watch_notify_pp 2026-02-13T08:06:14.686 INFO:tasks.workunit.client.0.trial119.stdout:test api_watch_notify_pp on pid 14358 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14358 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_watch_notify_pp on pid 14358' 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14358 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_cmd 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_cmd' 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_cmd 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_watch_notify_pp.xml 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2026-02-13T08:06:14.687 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2026-02-13T08:06:14.688 INFO:tasks.workunit.client.0.trial119.stdout:test api_cmd on pid 14389 2026-02-13T08:06:14.688 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_cmd 2026-02-13T08:06:14.688 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14389 2026-02-13T08:06:14.688 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_cmd on pid 14389' 2026-02-13T08:06:14.688 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14389 2026-02-13T08:06:14.688 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.688 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.688 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2026-02-13T08:06:14.688 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_cmd_pp 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_cmd_pp' 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_cmd_pp 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd.xml 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_cmd.log 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_cmd: /' 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_cmd_pp 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14429 2026-02-13T08:06:14.689 INFO:tasks.workunit.client.0.trial119.stdout:test api_cmd_pp on pid 14429 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_cmd_pp on pid 14429' 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14429 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_service 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_service' 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_service 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_cmd_pp.xml 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_cmd_pp: /' 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_service 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14461 2026-02-13T08:06:14.690 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_service on pid 14461' 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stdout:test api_service on pid 14461 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14461 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_service_pp 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_service_pp' 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_service_pp 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.691 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.692 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.692 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service.xml 2026-02-13T08:06:14.692 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_service.log 2026-02-13T08:06:14.692 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_service: /' 2026-02-13T08:06:14.692 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_service_pp 2026-02-13T08:06:14.692 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14482 2026-02-13T08:06:14.692 INFO:tasks.workunit.client.0.trial119.stdout:test api_service_pp on pid 14482 2026-02-13T08:06:14.692 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_service_pp on pid 14482' 2026-02-13T08:06:14.692 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14482 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_c_write_operations 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_c_write_operations' 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_c_write_operations 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_service_pp.xml 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_service_pp: /' 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_service_pp.log 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_c_write_operations 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14511 2026-02-13T08:06:14.693 INFO:tasks.workunit.client.0.trial119.stdout:test api_c_write_operations on pid 14511 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_c_write_operations on pid 14511' 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14511 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s api_c_read_operations 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' api_c_read_operations' 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:++ echo api_c_read_operations 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_write_operations.xml 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_c_write_operations: /' 2026-02-13T08:06:14.694 INFO:tasks.workunit.client.0.trial119.stdout:test api_c_read_operations on pid 14525 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=api_c_read_operations 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14525 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test api_c_read_operations on pid 14525' 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14525 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s list_parallel 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' list_parallel' 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:++ echo list_parallel 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/api_c_read_operations.xml 2026-02-13T08:06:14.695 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2026-02-13T08:06:14.696 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ api_c_read_operations: /' 2026-02-13T08:06:14.696 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=list_parallel 2026-02-13T08:06:14.696 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14548 2026-02-13T08:06:14.696 INFO:tasks.workunit.client.0.trial119.stdout:test list_parallel on pid 14548 2026-02-13T08:06:14.696 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test list_parallel on pid 14548' 2026-02-13T08:06:14.696 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14548 2026-02-13T08:06:14.696 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.696 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.696 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2026-02-13T08:06:14.696 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s open_pools_parallel 2026-02-13T08:06:14.696 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' open_pools_parallel' 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stderr:++ echo open_pools_parallel 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/list_parallel.xml 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_list_parallel.log 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ list_parallel: /' 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stdout:test open_pools_parallel on pid 14575 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=open_pools_parallel 2026-02-13T08:06:14.697 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14575 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test open_pools_parallel on pid 14575' 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14575 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s delete_pools_parallel 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' delete_pools_parallel' 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:++ echo delete_pools_parallel 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/open_pools_parallel.xml 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ open_pools_parallel: /' 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=delete_pools_parallel 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14601 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test delete_pools_parallel on pid 14601' 2026-02-13T08:06:14.698 INFO:tasks.workunit.client.0.trial119.stdout:test delete_pools_parallel on pid 14601 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14601 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s cls 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' cls' 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:++ echo cls 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/unit_test_xml_report/delete_pools_parallel.xml 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ delete_pools_parallel: /' 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=cls 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14612 2026-02-13T08:06:14.699 INFO:tasks.workunit.client.0.trial119.stdout:test cls on pid 14612 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test cls on pid 14612' 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14612 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s cmd 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' cmd' 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:++ echo cmd 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_cls 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_cls.log 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ cls: /' 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=cmd 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14633 2026-02-13T08:06:14.700 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test cmd on pid 14633' 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stdout:test cmd on pid 14633 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14633 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s handler_error 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' handler_error' 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:++ echo handler_error 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_cmd 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_cmd.log 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ cmd: /' 2026-02-13T08:06:14.701 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=handler_error 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stdout:test handler_error on pid 14654 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14654 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test handler_error on pid 14654' 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14654 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s io 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' io' 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:++ echo io 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.702 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_handler_error 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_handler_error.log 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ handler_error: /' 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=io 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stdout:test io on pid 14664 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14664 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test io on pid 14664' 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14664 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s ec_io 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' ec_io' 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:++ echo ec_io 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.703 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_io 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_io.log 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ io: /' 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=ec_io 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stdout:test ec_io on pid 14679 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14679 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test ec_io on pid 14679' 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14679 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s list 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' list' 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:++ echo list 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.704 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_ec_io 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_ec_io.log 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ ec_io: /' 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stdout:test list on pid 14707 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=list 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14707 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test list on pid 14707' 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14707 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s ec_list 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' ec_list' 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.705 INFO:tasks.workunit.client.0.trial119.stderr:++ echo ec_list 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_list 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_list.log 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ list: /' 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=ec_list 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stdout:test ec_list on pid 14743 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14743 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test ec_list on pid 14743' 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14743 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2026-02-13T08:06:14.706 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s misc 2026-02-13T08:06:14.707 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' misc' 2026-02-13T08:06:14.707 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.707 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.707 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.707 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.707 INFO:tasks.workunit.client.0.trial119.stderr:++ echo misc 2026-02-13T08:06:14.707 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.707 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_ec_list 2026-02-13T08:06:14.707 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_ec_list.log 2026-02-13T08:06:14.707 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ ec_list: /' 2026-02-13T08:06:14.708 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=misc 2026-02-13T08:06:14.708 INFO:tasks.workunit.client.0.trial119.stdout:test misc on pid 14757 2026-02-13T08:06:14.708 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14757 2026-02-13T08:06:14.708 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test misc on pid 14757' 2026-02-13T08:06:14.708 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14757 2026-02-13T08:06:14.708 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.708 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.708 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2026-02-13T08:06:14.708 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s pool 2026-02-13T08:06:14.708 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' pool' 2026-02-13T08:06:14.709 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.709 INFO:tasks.workunit.client.0.trial119.stderr:++ echo pool 2026-02-13T08:06:14.709 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.709 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.709 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.709 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.709 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_misc 2026-02-13T08:06:14.709 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_misc.log 2026-02-13T08:06:14.709 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ misc: /' 2026-02-13T08:06:14.710 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=pool 2026-02-13T08:06:14.710 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14783 2026-02-13T08:06:14.710 INFO:tasks.workunit.client.0.trial119.stdout:test pool on pid 14783 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test pool on pid 14783' 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14783 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s read_operations 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' read_operations' 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:++ echo read_operations 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_pool 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_pool.log 2026-02-13T08:06:14.711 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ pool: /' 2026-02-13T08:06:14.713 INFO:tasks.workunit.client.0.trial119.stdout:test read_operations on pid 14792 2026-02-13T08:06:14.713 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=read_operations 2026-02-13T08:06:14.713 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14792 2026-02-13T08:06:14.713 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test read_operations on pid 14792' 2026-02-13T08:06:14.713 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14792 2026-02-13T08:06:14.713 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.713 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.713 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2026-02-13T08:06:14.713 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s snapshots 2026-02-13T08:06:14.713 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' snapshots' 2026-02-13T08:06:14.714 INFO:tasks.workunit.client.0.trial119.stderr:++ echo snapshots 2026-02-13T08:06:14.714 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.714 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.714 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.714 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.714 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.714 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_read_operations 2026-02-13T08:06:14.714 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_read_operations.log 2026-02-13T08:06:14.714 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ read_operations: /' 2026-02-13T08:06:14.715 INFO:tasks.workunit.client.0.trial119.stdout:test snapshots on pid 14812 2026-02-13T08:06:14.715 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=snapshots 2026-02-13T08:06:14.715 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14812 2026-02-13T08:06:14.715 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test snapshots on pid 14812' 2026-02-13T08:06:14.715 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14812 2026-02-13T08:06:14.716 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.716 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.716 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2026-02-13T08:06:14.716 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s watch_notify 2026-02-13T08:06:14.716 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' watch_notify' 2026-02-13T08:06:14.716 INFO:tasks.workunit.client.0.trial119.stderr:++ echo watch_notify 2026-02-13T08:06:14.716 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.717 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.717 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.717 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.717 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.717 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_snapshots 2026-02-13T08:06:14.717 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_snapshots.log 2026-02-13T08:06:14.717 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ snapshots: /' 2026-02-13T08:06:14.718 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=watch_notify 2026-02-13T08:06:14.718 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14833 2026-02-13T08:06:14.718 INFO:tasks.workunit.client.0.trial119.stdout:test watch_notify on pid 14833 2026-02-13T08:06:14.718 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test watch_notify on pid 14833' 2026-02-13T08:06:14.718 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14833 2026-02-13T08:06:14.718 INFO:tasks.workunit.client.0.trial119.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2026-02-13T08:06:14.718 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.719 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2026-02-13T08:06:14.719 INFO:tasks.workunit.client.0.trial119.stderr:++ printf %25s write_operations 2026-02-13T08:06:14.719 INFO:tasks.workunit.client.0.trial119.stderr:+ r=' write_operations' 2026-02-13T08:06:14.719 INFO:tasks.workunit.client.0.trial119.stderr:++ echo write_operations 2026-02-13T08:06:14.719 INFO:tasks.workunit.client.0.trial119.stderr:++ awk '{print $1}' 2026-02-13T08:06:14.719 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.719 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.719 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.719 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.719 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_watch_notify 2026-02-13T08:06:14.719 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_watch_notify.log 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ watch_notify: /' 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stdout:test write_operations on pid 14847 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stderr:+ ff=write_operations 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14847 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stderr:+ echo 'test write_operations on pid 14847' 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stderr:+ pids[$f]=14847 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stderr:+ ret=0 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' 1 -eq 1 ']' 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14117 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14117 2026-02-13T08:06:14.720 INFO:tasks.workunit.client.0.trial119.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2026-02-13T08:06:14.721 INFO:tasks.workunit.client.0.trial119.stderr:+ '[' -z '' ']' 2026-02-13T08:06:14.721 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.721 INFO:tasks.workunit.client.0.trial119.stderr:+ case $- in 2026-02-13T08:06:14.721 INFO:tasks.workunit.client.0.trial119.stderr:+ return 2026-02-13T08:06:14.721 INFO:tasks.workunit.client.0.trial119.stderr:+ tee ceph_test_neorados_write_operations.log 2026-02-13T08:06:14.722 INFO:tasks.workunit.client.0.trial119.stderr:+ ceph_test_neorados_write_operations 2026-02-13T08:06:14.722 INFO:tasks.workunit.client.0.trial119.stderr:+ sed 's/^/ write_operations: /' 2026-02-13T08:06:15.612 INFO:tasks.workunit.client.0.trial119.stdout:jecter ms_handle_connect 0x7fd32003a050 2026-02-13T08:06:15.612 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== mon.2 v1:10.20.193.104:6790/0 10 ==== pool_op_reply(tid 1 (0) Success v20) ==== 43+0+0 (unknown 3063323808 0 0) 0x7fd338015590 con 0x5617efd7e1e0 2026-02-13T08:06:15.613 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 pool_op_reply(tid 1 (0) Success v20) 2026-02-13T08:06:15.613 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 10 client.4475.objecter handle_pool_op_reply pool_op_reply(tid 1 (0) Success v20) 2026-02-13T08:06:15.613 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 10 client.4475.objecter have request 1 at 0x5617efd97520 Op: create 2026-02-13T08:06:15.613 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 20 client.4475.objecter waiting for client to reach epoch 20 before calling back 2026-02-13T08:06:15.613 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 10 client.4475.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:06:15.613 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 10 monclient: _renew_subs 2026-02-13T08:06:15.613 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:06:15.613 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=20}) -- 0x5617efd96460 con 0x5617efd7e1e0 2026-02-13T08:06:15.613 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 10 client.4475.objecter done 2026-02-13T08:06:15.613 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== mon.2 v1:10.20.193.104:6790/0 11 ==== osd_map(20..20 src has 1..20) ==== 13374+0+0 (unknown 3663587826 0 0) 0x7fd3380479b0 con 0x5617efd7e1e0 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_map(20..20 src has 1..20) 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 3 client.4475.objecter handle_osd_map got epochs [20,20] > 19 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 3 client.4475.objecter handle_osd_map decoding incremental epoch 20 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 20 client.4475.objecter dump_active .. 0 homeless 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 10 librados: set snap read head -> 1 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 10 librados: writefull oid=exist nspace= 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe5e640 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 20 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 2 osd.4 2026-02-13T08:06:15.614 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:15.615 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 2 2026-02-13T08:06:15.615 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 15 client.4475.objecter _send_op 2 to 7.1 on osd.4 2026-02-13T08:06:16.719 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:2 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20) -- 0x5617efe857e0 con 0x5617efe83cf0 2026-02-13T08:06:16.719 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.719 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.719 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd341bb3640 10 monclient: get_auth_request con 0x5617efe83cf0 auth_method 0 2026-02-13T08:06:16.719 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:15.698+0000 7fd3327fc640 10 client.4475.objecter ms_handle_connect 0x5617efe83cf0 2026-02-13T08:06:16.719 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.762+0000 7fd3327fc640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 1 ==== osd_map(21..21 src has 1..21) ==== 7736+0+0 (unknown 2634825744 0 0) 0x7fd3340036a0 con 0x5617efe83cf0 2026-02-13T08:06:16.719 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.762+0000 7fd3327fc640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_map(21..21 src has 1..21) 2026-02-13T08:06:16.719 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.762+0000 7fd3327fc640 3 client.4475.objecter handle_osd_map got epochs [21,21] > 20 2026-02-13T08:06:16.720 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.762+0000 7fd3327fc640 3 client.4475.objecter handle_osd_map decoding incremental epoch 21 2026-02-13T08:06:16.720 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.766+0000 7fd3327fc640 10 client.4475.objecter checking op 2 2026-02-13T08:06:16.720 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.766+0000 7fd3327fc640 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.720 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.766+0000 7fd3327fc640 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.720 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.766+0000 7fd3327fc640 20 client.4475.objecter dump_active .. 0 homeless 2026-02-13T08:06:16.720 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.766+0000 7fd3327fc640 20 client.4475.objecter 2 7.d3a59201 osd.4 exist [writefull 0~5 in=5b] 2026-02-13T08:06:16.720 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 2 ==== osd_op_reply(2 exist [writefull 0~5] v21'1 uv1 ondisk = 0) ==== 149+0+0 (unknown 687663030 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.720 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(2 exist [writefull 0~5] v21'1 uv1 ondisk = 0) 2026-02-13T08:06:16.720 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.720 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 2 ondisk uv 1 in 7.1 attempt 0 2026-02-13T08:06:16.720 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 2 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _finish_op 2 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 2 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 librados: Objecter returned from writefull r=0 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe5e640 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.721 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [read 0~256] tid 3 osd.4 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 3 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _send_op 3 to 7.1 on osd.4 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:3 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe827d0 con 0x5617efe83cf0 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe82ca0 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.722 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [read 0~256] tid 4 osd.4 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 4 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _send_op 4 to 7.1 on osd.4 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:4 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe83150 con 0x5617efe83cf0 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 3 ==== osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2479589928 0 3741568377) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(3 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 3 ondisk uv 1 in 7.1 attempt 0 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 5 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 3 2026-02-13T08:06:16.723 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _finish_op 3 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 3 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 4 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 68189937 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 4 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 4 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _finish_op 4 2026-02-13T08:06:16.724 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 4 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (0 ms) 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadDeferred 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe82ca0 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [read 0~256] tid 5 osd.4 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 5 2026-02-13T08:06:16.725 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _send_op 5 to 7.1 on osd.4 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:5 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe5e640 con 0x5617efe83cf0 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe85b80 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [read 0~256] tid 6 osd.4 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 6 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _send_op 6 to 7.1 on osd.4 2026-02-13T08:06:16.726 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:6 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe86030 con 0x5617efe83cf0 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2479589928 0 3741568377) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(5 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 5 ondisk uv 1 in 7.1 attempt 0 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 5 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 5 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _finish_op 5 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 5 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.727 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 6 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 68189937 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 6 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 6 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadDeferred (0 ms) 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _finish_op 6 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 6 2026-02-13T08:06:16.728 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe85b80 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [read 0~256] tid 7 osd.4 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 7 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _send_op 7 to 7.1 on osd.4 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:7 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe82ca0 con 0x5617efe83cf0 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.729 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe86470 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [read 0~256] tid 8 osd.4 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 8 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _send_op 8 to 7.1 on osd.4 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:8 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe86920 con 0x5617efe83cf0 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.730 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2479589928 0 3741568377) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(7 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 7 ondisk uv 1 in 7.1 attempt 0 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 5 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 7 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _finish_op 7 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 7 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 8 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 68189937 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.731 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 8 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 8 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _finish_op 8 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 8 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (0 ms) 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe85b80 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.732 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [read 0~256] tid 9 osd.4 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 9 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _send_op 9 to 7.1 on osd.4 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:9 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe86d90 con 0x5617efe83cf0 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe87360 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.733 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [read 0~256] tid 10 osd.4 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 10 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _send_op 10 to 7.1 on osd.4 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:10 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87810 con 0x5617efe83cf0 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 9 ==== osd_op_reply(9 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2479589928 0 3741568377) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(9 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 9 ondisk uv 1 in 7.1 attempt 0 2026-02-13T08:06:16.734 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 5 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 9 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _finish_op 9 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 9 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 10 ==== osd_op_reply(10 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 68189937 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(10 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 10 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.735 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (0 ms) 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadAwaitable 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 10 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _finish_op 10 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 10 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe85b80 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [read 0~256] tid 11 osd.4 2026-02-13T08:06:16.736 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 11 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _send_op 11 to 7.1 on osd.4 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:11 7.1 7:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87360 con 0x5617efe83cf0 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe87840 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [read 0~256] tid 12 osd.4 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.737 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 12 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _send_op 12 to 7.1 on osd.4 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:12 7.1 7:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87cf0 con 0x5617efe83cf0 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 11 ==== osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) ==== 149+0+5 (unknown 2479589928 0 3741568377) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(11 exist [read 0~5 out=5b] v0'0 uv1 ondisk = 0) 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 11 ondisk uv 1 in 7.1 attempt 0 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 5 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 11 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _finish_op 11 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.738 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 11 2026-02-13T08:06:16.739 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.739 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 12 ==== osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 68189937 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.739 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(12 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.739 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.739 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 12 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.739 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.739 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.739 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 12 2026-02-13T08:06:16.744 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _finish_op 12 2026-02-13T08:06:16.744 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.744 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 12 2026-02-13T08:06:16.744 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.744 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadAwaitable (0 ms) 2026-02-13T08:06:16.744 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2026-02-13T08:06:16.744 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-13T08:06:16.744 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617efe87340 write_seq 1 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe85b80 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [write 0~5 in=5b] tid 13 osd.4 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 13 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 15 client.4475.objecter _send_op 13 to 7.1 on osd.4 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:13 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617efe88850 con 0x5617efe83cf0 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.745 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.806+0000 7fd3438dd980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 13 ==== osd_op_reply(13 exist [write 0~5] v21'2 uv2 ondisk = 0) ==== 149+0+0 (unknown 675978590 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(13 exist [write 0~5] v21'2 uv2 ondisk = 0) 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 13 ondisk uv 2 in 7.1 attempt 0 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 13 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 15 client.4475.objecter _finish_op 13 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 13 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (10 ms) 2026-02-13T08:06:16.746 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 20 librados: complete_aio_write 0x5617efe87340 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteDeferred 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617efe88c10 write_seq 2 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe85b80 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [write 0~5 in=5b] tid 14 osd.4 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 14 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 15 client.4475.objecter _send_op 14 to 7.1 on osd.4 2026-02-13T08:06:16.747 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:14 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617efe88850 con 0x5617efe83cf0 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 14 ==== osd_op_reply(14 exist [write 0~5] v21'3 uv3 ondisk = 0) ==== 149+0+0 (unknown 1556752010 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(14 exist [write 0~5] v21'3 uv3 ondisk = 0) 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 14 ondisk uv 3 in 7.1 attempt 0 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 14 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 15 client.4475.objecter _finish_op 14 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.748 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 14 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteDeferred (0 ms) 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 20 librados: complete_aio_write 0x5617efe88c10 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617efe87450 write_seq 3 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe85b80 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.749 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [write 0~5 in=5b] tid 15 osd.4 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 15 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 15 client.4475.objecter _send_op 15 to 7.1 on osd.4 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:15 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617efe88850 con 0x5617efe83cf0 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 15 ==== osd_op_reply(15 exist [write 0~5] v21'4 uv4 ondisk = 0) ==== 149+0+0 (unknown 379941719 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(15 exist [write 0~5] v21'4 uv4 ondisk = 0) 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 15 ondisk uv 4 in 7.1 attempt 0 2026-02-13T08:06:16.750 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 15 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 15 client.4475.objecter _finish_op 15 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 15 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd341bb3640 20 librados: complete_aio_write 0x5617efe87450 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (1 ms) 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617efe875f0 write_seq 4 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe8eb80 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.751 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [write 0~5 in=5b] tid 16 osd.4 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 16 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 15 client.4475.objecter _send_op 16 to 7.1 on osd.4 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:16 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617effb6300 con 0x5617efe83cf0 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.818+0000 7fd3438dd980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 16 ==== osd_op_reply(16 exist [write 0~5] v21'5 uv5 ondisk = 0) ==== 149+0+0 (unknown 1646643331 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(16 exist [write 0~5] v21'5 uv5 ondisk = 0) 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.752 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 16 ondisk uv 5 in 7.1 attempt 0 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 16 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 16 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (0 ms) 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteAwaitable 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 16 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 librados: complete_aio_write 0x5617efe875f0 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=head 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617efe88a60 write_seq 5 2026-02-13T08:06:16.753 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617eff762e0 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [write 0~5 in=5b] tid 17 osd.4 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 17 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 17 to 7.1 on osd.4 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:17 7.1 7:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617efe8eea0 con 0x5617efe83cf0 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 librados: aio_write exist 0~5 snapc=0=[] snap_seq=1 2026-02-13T08:06:16.754 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 17 ==== osd_op_reply(17 exist [write 0~5] v21'6 uv6 ondisk = 0) ==== 149+0+0 (unknown 4288939263 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(17 exist [write 0~5] v21'6 uv6 ondisk = 0) 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 17 ondisk uv 6 in 7.1 attempt 0 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 17 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 17 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 17 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 librados: complete_aio_write 0x5617efe88a60 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteAwaitable (0 ms) 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2026-02-13T08:06:16.755 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617eff762e0 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [read 0~0] tid 18 osd.4 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 18 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 18 to 7.1 on osd.4 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:18 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe8eea0 con 0x5617efe83cf0 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe87950 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.756 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [read 0~0] tid 19 osd.4 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 19 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 19 to 7.1 on osd.4 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:19 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87e00 con 0x5617efe83cf0 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 18 ==== osd_op_reply(18 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3585627667 0 3741568377) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(18 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 18 ondisk uv 6 in 7.1 attempt 0 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 5 2026-02-13T08:06:16.757 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 18 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 18 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 18 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 19 ==== osd_op_reply(19 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1771585737 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(19 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 19 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 19 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 19 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 19 2026-02-13T08:06:16.758 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (0 ms) 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationDeferred 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe87840 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [read 0~0] tid 20 osd.4 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 20 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 20 to 7.1 on osd.4 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:20 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87cf0 con 0x5617efe83cf0 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.759 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe881f0 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [read 0~0] tid 21 osd.4 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 21 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 21 to 7.1 on osd.4 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:21 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617eff762e0 con 0x5617efe83cf0 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 20 ==== osd_op_reply(20 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3585627667 0 3741568377) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(20 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 20 ondisk uv 6 in 7.1 attempt 0 2026-02-13T08:06:16.760 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 5 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 20 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 20 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 20 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 21 ==== osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1771585737 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(21 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 21 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 21 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 21 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.761 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 21 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationDeferred (0 ms) 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe880e0 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [read 0~0] tid 22 osd.4 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 22 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 22 to 7.1 on osd.4 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:22 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617eff762e0 2026-02-13T08:06:16.762 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [read 0~0] tid 23 osd.4 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 23 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 23 to 7.1 on osd.4 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:23 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617eff76790 con 0x5617efe83cf0 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 22 ==== osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3585627667 0 3741568377) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(22 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 22 ondisk uv 6 in 7.1 attempt 0 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 5 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 22 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 22 2026-02-13T08:06:16.763 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 22 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 23 ==== osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1771585737 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(23 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 23 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 23 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 23 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 23 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (0 ms) 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe880e0 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.764 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [read 0~0] tid 24 osd.4 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 24 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 24 to 7.1 on osd.4 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:24 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617effb6300 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [read 0~0] tid 25 osd.4 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 25 2026-02-13T08:06:16.765 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 25 to 7.1 on osd.4 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:25 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87cc0 con 0x5617efe83cf0 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 24 ==== osd_op_reply(24 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3585627667 0 3741568377) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(24 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 24 ondisk uv 6 in 7.1 attempt 0 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 5 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 24 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 24 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 24 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 25 ==== osd_op_reply(25 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1771585737 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(25 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 25 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.766 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 25 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 25 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 25 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationAwaitable 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe87cc0 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [read 0~0] tid 26 osd.4 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 26 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 26 to 7.1 on osd.4 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:26 7.1 7:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.767 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe88280 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [read 0~0] tid 27 osd.4 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 27 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 27 to 7.1 on osd.4 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:27 7.1 7:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617eff762e0 con 0x5617efe83cf0 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 26 ==== osd_op_reply(26 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) ==== 149+0+5 (unknown 3585627667 0 3741568377) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(26 exist [read 0~5 out=5b] v0'0 uv6 ondisk = 0) 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 26 ondisk uv 6 in 7.1 attempt 0 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 5 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 26 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 26 2026-02-13T08:06:16.768 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 26 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 27 ==== osd_op_reply(27 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1771585737 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(27 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 27 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 27 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 27 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 27 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationAwaitable (0 ms) 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617efe8f050 write_seq 6 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe87cc0 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.769 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 28 osd.4 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 28 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 28 to 7.1 on osd.4 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:28 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 28 ==== osd_op_reply(28 exist [writefull 0~5] v21'7 uv7 ondisk = 0) ==== 149+0+0 (unknown 370346431 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(28 exist [writefull 0~5] v21'7 uv7 ondisk = 0) 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 28 ondisk uv 7 in 7.1 attempt 0 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 28 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 28 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 28 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (0 ms) 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationDeferred 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.770 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 librados: complete_aio_write 0x5617efe8f050 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617efe88170 write_seq 7 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe87c30 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 29 osd.4 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 29 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 29 to 7.1 on osd.4 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:29 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 29 ==== osd_op_reply(29 exist [writefull 0~5] v21'8 uv8 ondisk = 0) ==== 149+0+0 (unknown 4132248017 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(29 exist [writefull 0~5] v21'8 uv8 ondisk = 0) 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 29 ondisk uv 8 in 7.1 attempt 0 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 29 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _finish_op 29 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.771 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 29 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationDeferred (0 ms) 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd341bb3640 20 librados: complete_aio_write 0x5617efe88170 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617efe8f050 write_seq 8 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe87c30 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 30 osd.4 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 30 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 15 client.4475.objecter _send_op 30 to 7.1 on osd.4 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:30 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.822+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 30 ==== osd_op_reply(30 exist [writefull 0~5] v21'9 uv9 ondisk = 0) ==== 149+0+0 (unknown 2194514437 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(30 exist [writefull 0~5] v21'9 uv9 ondisk = 0) 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 30 ondisk uv 9 in 7.1 attempt 0 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.772 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 30 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 30 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 30 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 librados: complete_aio_write 0x5617efe8f050 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (0 ms) 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617efe880e0 write_seq 9 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe88210 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 31 osd.4 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 31 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 31 to 7.1 on osd.4 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:31 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.773 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 31 ==== osd_op_reply(31 exist [writefull 0~5] v21'10 uv10 ondisk = 0) ==== 149+0+0 (unknown 525102713 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(31 exist [writefull 0~5] v21'10 uv10 ondisk = 0) 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 31 ondisk uv 10 in 7.1 attempt 0 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 31 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 31 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1 ms) 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationAwaitable 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 31 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 librados: complete_aio_write 0x5617efe880e0 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617efe8f050 write_seq 10 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe87cf0 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [writefull 0~5 in=5b] tid 32 osd.4 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 32 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 32 to 7.1 on osd.4 2026-02-13T08:06:16.774 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:32 7.1 7:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 32 ==== osd_op_reply(32 exist [writefull 0~5] v21'11 uv11 ondisk = 0) ==== 149+0+0 (unknown 1808586157 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(32 exist [writefull 0~5] v21'11 uv11 ondisk = 0) 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 32 ondisk uv 11 in 7.1 attempt 0 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 32 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 32 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 32 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 librados: complete_aio_write 0x5617efe8f050 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationAwaitable (0 ms) 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyCallback 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter linger_register info 0x5617efe87cf0 linger_id 1 cookie 94660809227504 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_linger_op_assign 4 1 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.775 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter send_linger 1 register 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe88300 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [notify cookie 94660809227504 in=17b] tid 33 osd.4 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 33 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 33 to 7.1 on osd.4 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:33 7.1 7:8049a5cb:::exist:head [notify cookie 94660809227504 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter linger_register info 0x5617eff78410 linger_id 2 cookie 94660810212368 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_linger_op_assign 4 2 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter send_linger 2 register 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617eff79ae0 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.776 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [notify cookie 94660810212368 in=17b] tid 34 osd.4 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 34 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 34 to 7.1 on osd.4 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:34 7.1 7:855dde50:::noexist:head [notify cookie 94660810212368 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 7 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 33 ==== watch-notify(notify_complete (2) cookie 94660809227504 notify 90194313216 ret 0) ==== 42+0+8 (unknown 1335617501 0 0) 0x7fd334009020 con 0x5617efe83cf0 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 watch-notify(notify_complete (2) cookie 94660809227504 notify 90194313216 ret 0) 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 librados: operator() completed notify (linger op 0x5617efe87cf0), ec = system:0 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 34 ==== osd_op_reply(33 exist [notify cookie 94660809227504 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1174439656 0 1325607542) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(33 exist [notify cookie 94660809227504 out=8b] v0'0 uv11 ondisk = 0) 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 33 ondisk uv 11 in 7.1 attempt 0 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 8 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 33 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 33 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 7 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 33 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 client.4475.objecter _linger_commit 1 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 client.4475.objecter _linger_commit notify_id=90194313216 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 librados: finish linger op 0x5617efe87cf0 acked (0) 2026-02-13T08:06:16.777 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 20 client.4475.objecter _linger_cancel linger_id=1 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 15 client.4475.objecter _session_linger_op_remove 4 1 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 35 ==== osd_op_reply(34 noexist [notify cookie 94660810212368] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 1359406715 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(34 noexist [notify cookie 94660810212368] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 34 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 34 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 34 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 34 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 client.4475.objecter _linger_commit 2 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 librados: finish linger op 0x5617eff78410 acked (-2) 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 librados: operator() completed notify (linger op 0x5617eff78410), ec = osd:2 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 20 client.4475.objecter _linger_cancel linger_id=2 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 15 client.4475.objecter _session_linger_op_remove 4 2 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyCallback (0 ms) 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyDeferred 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter linger_register info 0x5617efe87cf0 linger_id 3 cookie 94660809227504 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.778 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_linger_op_assign 4 3 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter send_linger 3 register 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe88300 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [notify cookie 94660809227504 in=17b] tid 35 osd.4 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 35 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 35 to 7.1 on osd.4 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:35 7.1 7:8049a5cb:::exist:head [notify cookie 94660809227504 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter linger_register info 0x5617eff79420 linger_id 4 cookie 94660810216480 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_linger_op_assign 4 4 2026-02-13T08:06:16.779 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter send_linger 4 register 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efd90960 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [notify cookie 94660810216480 in=17b] tid 36 osd.4 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 36 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 36 to 7.1 on osd.4 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:36 7.1 7:855dde50:::noexist:head [notify cookie 94660810216480 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efd90e10 con 0x5617efe83cf0 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 7 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 36 ==== watch-notify(notify_complete (2) cookie 94660809227504 notify 90194313217 ret 0) ==== 42+0+8 (unknown 4124321107 0 0) 0x7fd334009020 con 0x5617efe83cf0 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 watch-notify(notify_complete (2) cookie 94660809227504 notify 90194313217 ret 0) 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 librados: operator() completed notify (linger op 0x5617efe87cf0), ec = system:0 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 37 ==== osd_op_reply(35 exist [notify cookie 94660809227504 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1174439656 0 104814417) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(35 exist [notify cookie 94660809227504 out=8b] v0'0 uv11 ondisk = 0) 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 35 ondisk uv 11 in 7.1 attempt 0 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 8 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 35 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 35 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 7 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 35 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.780 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 client.4475.objecter _linger_commit 3 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 client.4475.objecter _linger_commit notify_id=90194313217 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 librados: finish linger op 0x5617efe87cf0 acked (0) 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 20 client.4475.objecter _linger_cancel linger_id=3 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 15 client.4475.objecter _session_linger_op_remove 4 3 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 38 ==== osd_op_reply(36 noexist [notify cookie 94660810216480] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 3282999429 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(36 noexist [notify cookie 94660810216480] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 36 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 36 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 36 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 36 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 client.4475.objecter _linger_commit 4 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 librados: finish linger op 0x5617eff79420 acked (-2) 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 librados: operator() completed notify (linger op 0x5617eff79420), ec = osd:2 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 20 client.4475.objecter _linger_cancel linger_id=4 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 15 client.4475.objecter _session_linger_op_remove 4 4 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyDeferred (0 ms) 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyFuture 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter linger_register info 0x5617efe87cf0 linger_id 5 cookie 94660809227504 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.781 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_linger_op_assign 4 5 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter send_linger 5 register 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe88300 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [notify cookie 94660809227504 in=17b] tid 37 osd.4 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 37 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 37 to 7.1 on osd.4 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:37 7.1 7:8049a5cb:::exist:head [notify cookie 94660809227504 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter linger_register info 0x5617eff78300 linger_id 6 cookie 94660810212096 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_linger_op_assign 4 6 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter send_linger 6 register 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efd8f950 2026-02-13T08:06:16.782 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [notify cookie 94660810212096 in=17b] tid 38 osd.4 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 38 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 38 to 7.1 on osd.4 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:38 7.1 7:855dde50:::noexist:head [notify cookie 94660810212096 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efd8fe00 con 0x5617efe83cf0 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 7 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 39 ==== watch-notify(notify_complete (2) cookie 94660809227504 notify 90194313218 ret 0) ==== 42+0+8 (unknown 1055396912 0 0) 0x7fd334009020 con 0x5617efe83cf0 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 watch-notify(notify_complete (2) cookie 94660809227504 notify 90194313218 ret 0) 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 librados: operator() completed notify (linger op 0x5617efe87cf0), ec = system:0 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 40 ==== osd_op_reply(37 exist [notify cookie 94660809227504 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1174439656 0 3715878968) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(37 exist [notify cookie 94660809227504 out=8b] v0'0 uv11 ondisk = 0) 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 37 ondisk uv 11 in 7.1 attempt 0 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 8 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 37 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 37 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 7 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 37 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 client.4475.objecter _linger_commit 5 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 client.4475.objecter _linger_commit notify_id=90194313218 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 librados: finish linger op 0x5617efe87cf0 acked (0) 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 20 client.4475.objecter _linger_cancel linger_id=5 2026-02-13T08:06:16.783 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 15 client.4475.objecter _session_linger_op_remove 4 5 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 41 ==== osd_op_reply(38 noexist [notify cookie 94660810212096] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 904758695 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(38 noexist [notify cookie 94660810212096] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 38 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 38 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 38 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 38 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 client.4475.objecter _linger_commit 6 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 librados: finish linger op 0x5617eff78300 acked (-2) 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 librados: operator() completed notify (linger op 0x5617eff78300), ec = osd:2 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 20 client.4475.objecter _linger_cancel linger_id=6 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 15 client.4475.objecter _session_linger_op_remove 4 6 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyFuture (0 ms) 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyYield 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter linger_register info 0x5617efe87cf0 linger_id 7 cookie 94660809227504 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.784 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_linger_op_assign 4 7 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter send_linger 7 register 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe88120 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [notify cookie 94660809227504 in=17b] tid 39 osd.4 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 39 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 39 to 7.1 on osd.4 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:39 7.1 7:8049a5cb:::exist:head [notify cookie 94660809227504 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter linger_register info 0x5617eff78300 linger_id 8 cookie 94660810212096 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_linger_op_assign 4 8 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter send_linger 8 register 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efd8f900 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.785 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [notify cookie 94660810212096 in=17b] tid 40 osd.4 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 40 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 40 to 7.1 on osd.4 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:40 7.1 7:855dde50:::noexist:head [notify cookie 94660810212096 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efd8fe70 con 0x5617efe83cf0 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 7 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 42 ==== watch-notify(notify_complete (2) cookie 94660809227504 notify 90194313219 ret 0) ==== 42+0+8 (unknown 2225591998 0 0) 0x7fd334009020 con 0x5617efe83cf0 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 watch-notify(notify_complete (2) cookie 94660809227504 notify 90194313219 ret 0) 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 librados: operator() completed notify (linger op 0x5617efe87cf0), ec = system:0 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 43 ==== osd_op_reply(39 exist [notify cookie 94660809227504 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 1174439656 0 2487725343) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(39 exist [notify cookie 94660809227504 out=8b] v0'0 uv11 ondisk = 0) 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 39 ondisk uv 11 in 7.1 attempt 0 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 8 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 39 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 39 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 7 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 39 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 client.4475.objecter _linger_commit 7 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 client.4475.objecter _linger_commit notify_id=90194313219 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 librados: finish linger op 0x5617efe87cf0 acked (0) 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 20 client.4475.objecter _linger_cancel linger_id=7 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 15 client.4475.objecter _session_linger_op_remove 4 7 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 44 ==== osd_op_reply(40 noexist [notify cookie 94660810212096] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 904758695 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.786 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(40 noexist [notify cookie 94660810212096] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 40 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 40 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 40 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 40 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 client.4475.objecter _linger_commit 8 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 librados: finish linger op 0x5617eff78300 acked (-2) 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 librados: operator() completed notify (linger op 0x5617eff78300), ec = osd:2 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 20 client.4475.objecter _linger_cancel linger_id=8 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 15 client.4475.objecter _session_linger_op_remove 4 8 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyYield (0 ms) 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncNotifyAwaitable 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter linger_register info 0x5617efd8f900 linger_id 9 cookie 94660808210688 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.d3a59201 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_linger_op_assign 4 9 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter send_linger 9 register 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe87cf0 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base exist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target exist @7 -> pgid 7.d3a59201 2026-02-13T08:06:16.787 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid exist '@7' '@7' [notify cookie 94660808210688 in=17b] tid 41 osd.4 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 41 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 41 to 7.1 on osd.4 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:41 7.1 7:8049a5cb:::exist:head [notify cookie 94660808210688 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter linger_register info 0x5617efe881a0 linger_id 10 cookie 94660809228704 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_linger_op_assign 4 10 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter send_linger 10 register 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efd8fe30 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [notify cookie 94660809228704 in=17b] tid 42 osd.4 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 6 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 42 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 42 to 7.1 on osd.4 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:42 7.1 7:855dde50:::noexist:head [notify cookie 94660809228704 in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efd902e0 con 0x5617efe83cf0 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 7 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 2 in flight 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 45 ==== watch-notify(notify_complete (2) cookie 94660808210688 notify 90194313220 ret 0) ==== 42+0+8 (unknown 3799690147 0 0) 0x7fd334009020 con 0x5617efe83cf0 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 watch-notify(notify_complete (2) cookie 94660808210688 notify 90194313220 ret 0) 2026-02-13T08:06:16.788 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 librados: operator() completed notify (linger op 0x5617efd8f900), ec = system:0 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 46 ==== osd_op_reply(41 exist [notify cookie 94660808210688 out=8b] v0'0 uv11 ondisk = 0) ==== 149+0+8 (unknown 3950561245 0 1847502875) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(41 exist [notify cookie 94660808210688 out=8b] v0'0 uv11 ondisk = 0) 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 41 ondisk uv 11 in 7.1 attempt 0 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 8 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 41 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 41 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 7 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 41 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 client.4475.objecter _linger_commit 9 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 client.4475.objecter _linger_commit notify_id=90194313220 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 10 librados: finish linger op 0x5617efd8f900 acked (0) 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 20 client.4475.objecter _linger_cancel linger_id=9 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3337fe640 15 client.4475.objecter _session_linger_op_remove 4 9 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 47 ==== osd_op_reply(42 noexist [notify cookie 94660809228704] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 2032661237 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(42 noexist [notify cookie 94660809228704] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 42 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter handle_osd_op_reply copying resulting 0 into existing ceph::buffer of length 0 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 42 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 42 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 5 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 42 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 client.4475.objecter _linger_commit 10 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 librados: finish linger op 0x5617efe881a0 acked (-2) 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 10 librados: operator() completed notify (linger op 0x5617efe881a0), ec = osd:2 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncNotifyAwaitable (0 ms) 2026-02-13T08:06:16.789 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTerminal 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 20 client.4475.objecter _linger_cancel linger_id=10 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd332ffd640 15 client.4475.objecter _session_linger_op_remove 4 10 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efd8fe10 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [stat] tid 43 osd.4 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 43 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTerminal (0 ms) 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCancelTotal 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 43 to 7.1 on osd.4 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:43 7.1 7:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617efe87840 con 0x5617efe83cf0 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter _op_cancel: cancelling tid 43 r=-125 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter op_cancel tid 43 in session 4 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _finish_op 43 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_remove 4 43 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCancelTotal (0 ms) 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTerminal 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efd8fe10 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_read 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [stat] tid 44 osd.4 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.790 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 44 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 44 to 7.1 on osd.4 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:44 7.1 7:855dde50:::noexist:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e21) -- 0x5617eff794f0 con 0x5617efe83cf0 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTerminal (0 ms) 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCancelTotal 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter _op_cancel: cancelling tid 44 r=-125 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter op_cancel tid 44 in session 4 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _finish_op 44 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_remove 4 44 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617eff79e20 write_seq 11 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efd8fe10 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [stat] tid 45 osd.4 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 45 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 45 to 7.1 on osd.4 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:45 7.1 7:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617eff794f0 con 0x5617efe83cf0 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter _op_cancel: cancelling tid 45 r=-125 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter op_cancel tid 45 in session 4 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 librados: complete_aio_write 0x5617eff79e20 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _finish_op 45 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_remove 4 45 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 librados: queue_aio_write 0x5617efcca5b0 completion 0x5617eff79e20 write_seq 12 2026-02-13T08:06:16.791 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit op 0x5617efe87cf0 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target epoch 21 base noexist @7 precalc_pgid 0 pgid 0.0 is_write 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _calc_target target noexist @7 -> pgid 7.a7bbaa1 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _calc_target raw pgid 7.a7bbaa1 -> actual 7.1 acting [4,0] primary 4 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter _get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 10 client.4475.objecter _op_submit oid noexist '@7' '@7' [stat] tid 46 osd.4 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter get_session s=0x5617efe315f0 osd=4 3 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _session_op_assign 4 46 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 15 client.4475.objecter _send_op 46 to 7.1 on osd.4 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 --> v1:10.20.193.119:6808/1543069880 -- osd_op(unknown.0.0:46 7.1 7:855dde50:::noexist:head [stat] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21) -- 0x5617eff794f0 con 0x5617efe83cf0 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd3438dd980 5 client.4475.objecter 1 in flight 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 48 ==== osd_op_reply(43 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4105172573 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(43 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 43 ondisk ... stray 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 49 ==== osd_op_reply(44 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4105172573 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(44 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 44 ondisk ... stray 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 50 ==== osd_op_reply(45 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4236894167 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(45 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 45 ondisk ... stray 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 <== osd.4 v1:10.20.193.119:6808/1543069880 51 ==== osd_op_reply(46 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (unknown 4236894167 0 0) 0x7fd3340039a0 con 0x5617efe83cf0 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter ms_dispatch2 0x5617efcf29c0 osd_op_reply(46 noexist [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter in handle_osd_op_reply 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 7 client.4475.objecter handle_osd_op_reply 46 ondisk uv 0 in 7.1 attempt 0 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 10 client.4475.objecter op 0 rval 0 len 0 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter handle_osd_op_reply completed tid 46 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _finish_op 46 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 4 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCancelTotal (0 ms) 2026-02-13T08:06:16.792 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 15 client.4475.objecter _session_op_remove 4 46 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 5 client.4475.objecter 0 in flight 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.826+0000 7fd341bb3640 20 librados: complete_aio_write 0x5617eff79e20 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 10 librados: watch_flush enter 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 10 librados: watch_flush exit 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 10 client.4475.objecter close_session for osd.4 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 >> v1:10.20.193.119:6808/1543069880 conn(0x5617efe83cf0 legacy=0x5617efe840c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 20 client.4475.objecter put_session s=0x5617efe315f0 osd=4 1 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 20 client.4475.objecter shutdown clearing up homeless session... 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 10 client.4475.objecter successfully canceled tick 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 >> v1:10.20.193.119:6812/276487904 conn(0x7fd32003a050 legacy=0x7fd32005a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 10 monclient: shutdown 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 >> v1:10.20.193.104:6790/0 conn(0x5617efd7e1e0 legacy=0x5617efe30d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd341bb3640 1 -- 10.20.193.119:0/3608333172 reap_dead start 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 shutdown_connections 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 >> 10.20.193.119:0/3608333172 conn(0x5617efd9c3e0 msgr2=0x5617efd96670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 shutdown_connections 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 1 -- 10.20.193.119:0/3608333172 wait complete. 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.830+0000 7fd3438dd980 1 librados: shutdown 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [----------] 29 tests from AsioRados (23 ms total) 2026-02-13T08:06:16.793 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: 2026-02-13T08:06:16.794 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [----------] Global test environment tear-down 2026-02-13T08:06:16.794 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [==========] 29 tests from 1 test suite ran. (2085 ms total) 2026-02-13T08:06:16.794 INFO:tasks.workunit.client.0.trial119.stdout: api_asio: [ PASSED ] 29 tests. 2026-02-13T08:06:16.794 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:06:16.794 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14248 2026-02-13T08:06:16.794 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14248 2026-02-13T08:06:16.932 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2026-02-13T08:06:16.932 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [----------] Global test environment set-up. 2026-02-13T08:06:16.932 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [----------] 7 tests from LibRadosList 2026-02-13T08:06:16.932 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2026-02-13T08:06:16.932 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ OK ] LibRadosList.ListObjects (137 ms) 2026-02-13T08:06:16.932 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (17 ms) 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: myset foo1,foo2,foo3 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo1 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo2 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo3 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: myset foo1,foo4,foo5 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo4 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo5 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo1 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: myset foo6,foo7 2026-02-13T08:06:16.933 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo7 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo6 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: ns1:foo4 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: ns1:foo5 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: ns2:foo7 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: ns2:foo6 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: ns1:foo1 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: :foo1 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: :foo2 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: :foo3 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (49 ms) 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2026-02-13T08:06:16.934 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 1 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 10 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 13 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 7 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 14 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 0 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 15 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 11 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 5 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 8 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 6 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 3 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 4 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 12 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 9 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 2 0 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (44 ms) 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2026-02-13T08:06:16.935 INFO:tasks.workunit.client.0.trial119.stdout: api_list: x cursor=MIN 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=1 cursor=10:02547ec2:::1:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=10 cursor=10:52ea6a34:::10:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=13 cursor=10:566253c9:::13:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=7 cursor=10:5c6b0b28:::7:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=14 cursor=10:62a1935d:::14:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=0 cursor=10:6cac518f:::0:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=15 cursor=10:863748b0:::15:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=11 cursor=10:89d3ae78:::11:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=5 cursor=10:b29083e3:::5:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=8 cursor=10:bd63b0f1:::8:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=6 cursor=10:c4fdafeb:::6:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=3 cursor=10:cfc208b3:::3:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=4 cursor=10:d83876eb:::4:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=12 cursor=10:de5d7c5f:::12:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=9 cursor=10:e960b815:::9:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > oid=2 cursor=10:f905c69b:::2:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: FIRST> seek to MIN oid=1 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=1 cursor=10:02547ec2:::1:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:02547ec2:::1:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:02547ec2:::1:head -> 1 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=10 cursor=10:52ea6a34:::10:head 2026-02-13T08:06:16.936 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:52ea6a34:::10:head 2026-02-13T08:06:16.937 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:52ea6a34:::10:head -> 10 2026-02-13T08:06:16.937 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=13 cursor=10:566253c9:::13:head 2026-02-13T08:06:16.937 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:566253c9:::13:head 2026-02-13T08:06:16.937 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:566253c9:::13:head -> 13 2026-02-13T08:06:16.937 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=7 cursor=10:5c6b0b28:::7:head 2026-02-13T08:06:16.937 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:5c6b0b28:::7:head 2026-02-13T08:06:16.937 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:5c6b0b28:::7:head -> 7 2026-02-13T08:06:16.984 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=14 cursor=10:62a1935d:::14:head 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:62a1935d:::14:head 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:62a1935d:::14:head -> 14 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=0 cursor=10:6cac518f:::0:head 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:6cac518f:::0:head 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:6cac518f:::0:head -> 0 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=15 cursor=10:863748b0:::15:head 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:863748b0:::15:head 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:863748b0:::15:head -> 15 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=11 cursor=10:89d3ae78:::11:head 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:89d3ae78:::11:head 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:89d3ae78:::11:head -> 11 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=5 cursor=10:b29083e3:::5:head 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:b29083e3:::5:head 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:b29083e3:::5:head -> 5 2026-02-13T08:06:16.985 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=8 cursor=10:bd63b0f1:::8:head 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:bd63b0f1:::8:head 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:bd63b0f1:::8:head -> 8 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=6 cursor=10:c4fdafeb:::6:head 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:c4fdafeb:::6:head 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:c4fdafeb:::6:head -> 6 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=3 cursor=10:cfc208b3:::3:head 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:cfc208b3:::3:head 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:cfc208b3:::3:head -> 3 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=4 cursor=10:d83876eb:::4:head 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:d83876eb:::4:head 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:d83876eb:::4:head -> 4 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=12 cursor=10:de5d7c5f:::12:head 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:de5d7c5f:::12:head 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:de5d7c5f:::12:head -> 12 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=9 cursor=10:e960b815:::9:head 2026-02-13T08:06:16.986 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:e960b815:::9:head 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:e960b815:::9:head -> 9 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : oid=2 cursor=10:f905c69b:::2:head 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:f905c69b:::2:head 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:f905c69b:::2:head -> 2 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:b29083e3:::5:head 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:b29083e3:::5:head expected=10:b29083e3:::5:head 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:b29083e3:::5:head -> 5 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=5 expected=5 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:89d3ae78:::11:head 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:89d3ae78:::11:head expected=10:89d3ae78:::11:head 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:89d3ae78:::11:head -> 11 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=11 expected=11 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:863748b0:::15:head 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:863748b0:::15:head expected=10:863748b0:::15:head 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:863748b0:::15:head -> 15 2026-02-13T08:06:16.987 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=15 expected=15 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:6cac518f:::0:head 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:6cac518f:::0:head expected=10:6cac518f:::0:head 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:6cac518f:::0:head -> 0 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=0 expected=0 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:566253c9:::13:head 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:566253c9:::13:head expected=10:566253c9:::13:head 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:566253c9:::13:head -> 13 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=13 expected=13 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:52ea6a34:::10:head 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:52ea6a34:::10:head expected=10:52ea6a34:::10:head 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:52ea6a34:::10:head -> 10 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=10 expected=10 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:02547ec2:::1:head 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:02547ec2:::1:head expected=10:02547ec2:::1:head 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:02547ec2:::1:head -> 1 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=1 expected=1 2026-02-13T08:06:16.988 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:5c6b0b28:::7:head 2026-02-13T08:06:16.989 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:5c6b0b28:::7:head expected=10:5c6b0b28:::7:head 2026-02-13T08:06:16.989 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:5c6b0b28:::7:head -> 7 2026-02-13T08:06:17.092 INFO:tasks.workunit.client.0.trial119.stdout: api_li list_parallel: process_1_[14621]: starting. 2026-02-13T08:06:17.092 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_1_[14621]: creating pool ceph_test_rados_list_parallel.trial119-14559 2026-02-13T08:06:17.092 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_1_[14621]: created object 0... 2026-02-13T08:06:17.092 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_1_[14621]: created object 25... 2026-02-13T08:06:17.092 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_1_[14621]: created object 49... 2026-02-13T08:06:17.092 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_1_[14621]: finishing. 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_1_[14621]: shutting down. 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_2_[14625]: starting. 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_2_[14625]: listing objects. 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_2_[14625]: listed object 0... 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_2_[14625]: listed object 25... 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_2_[14625]: saw 50 objects 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_2_[14625]: shutting down. 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_3_[15233]: starting. 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_3_[15233]: creating pool ceph_test_rados_list_parallel.trial119-14559 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_3_[15233]: created object 0... 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_3_[15233]: created object 25... 2026-02-13T08:06:17.093 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_3_[15233]: created object 49... 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_3_[15233]: finishing. 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_3_[15233]: shutting down. 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_4_[15234]: starting. 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_4_[15234]: listing objects. 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_4_[15234]: listed object 0... 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_4_[15234]: listed object 25... 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_4_[15234]: saw 42 objects 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_4_[15234]: shutting down. 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_5_[15235]: starting. 2026-02-13T08:06:17.094 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_5_[15235]: removed 25 objects... 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_5_[15235]: removed half of the objects 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_5_[15235]: removed 50 objects... 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_5_[15235]: removed 50 objects 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_5_[15235]: shutting down. 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_6_[15288]: starting. 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_6_[15288]: creating pool ceph_test_rados_list_parallel.trial119-14559 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_6_[15288]: created object 0... 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_6_[15288]: created object 25... 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_6_[15288]: created object 49... 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_6_[15288]: finishing. 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_6_[15288]: shutting down. 2026-02-13T08:06:17.095 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_7_[15289]: starting. 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_7_[15289]: listing objects. 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_7_[15289]: listed object 0... 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_7_[15289]: listed object 25... 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_7_[15289]: listed object 50... 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_7_[15289]: saw 56 objects 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_7_[15289]: shutting down. 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_8_[15290]: starting. 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_8_[15290]: added 25 objects... 2026-02-13T08:06:17.096 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_8_[15290]: added half of the objects 2026-02-13T08:06:17.097 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_8_[15290]: added 50 objects... 2026-02-13T08:06:17.097 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_8_[15290]: added 50 objects 2026-02-13T08:06:17.097 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_8_[15290]: shutting down. 2026-02-13T08:06:17.097 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.097 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.240 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.240 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_9_[15340]: starting. 2026-02-13T08:06:17.240 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_9_[15340]: creating pool ceph_test_rados_list_parallel.trial119-14559 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_9_[15340]: created object 0... 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_9_[15340]: created object 25... 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_9_[15340]: created object 49... 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_9_[15340]: finishing. 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_9_[15340]: shutting down. 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_10_[15341]: starting. 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_10_[15341]: listing objects. 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_10_[15341]: listed object 0... 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_10_[15341]: listed object 25... 2026-02-13T08:06:17.241 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_10_[15341]: listed object 50... 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_10_[15341]: listed object 75... 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_10_[15341]: saw 97 objects 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_10_[15341]: shutting down. 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_13_[15344]: starting. 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_13_[15344]: removed 25 objects... 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_13_[15344]: removed half of the objects 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_13_[15344]: removed 50 objects... 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_13_[15344]: removed 50 objects 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_13_[15344]: shutting down. 2026-02-13T08:06:17.242 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_12_[15343]: starting. 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_12_[15343]: added 25 objects... 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_12_[15343]: added half of the objects 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_12_[15343]: added 50 objects... 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_12_[15343]: added 50 objects 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_12_[15343]: shutting down. 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.243 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_11_[15342]: starting. 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_11_[15342]: added 25 objects... 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_11_[15342]: added half of the objects 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_11_[15342]: added 50 objects... 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_11_[15342]: added 50 objects 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_11_[15342]: shutting down. 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_14_[15425]: starting. 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_14_[15425]: creating pool ceph_test_rados_list_parallel.trial119-14559 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_14_[15425]: created object 0... 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_14_[15425]: created object 25... 2026-02-13T08:06:17.244 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_14_[15425]: created object 49... 2026-02-13T08:06:17.245 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_14_[15425]: finishing. 2026-02-13T08:06:17.245 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_14_[15425]: shutting down. 2026-02-13T08:06:17.245 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.245 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.245 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.245 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.245 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_15_[15426]: starting. 2026-02-13T08:06:17.245 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_15_[15426]: listing objects. 2026-02-13T08:06:17.245 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_15_[15426]: listed object 0... 2026-02-13T08:06:17.245 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_15_[15426]: listed object 25... 2026-02-13T08:06:17.622 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_15_[15426]: listed object 50... 2026-02-13T08:06:17.622 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_15_[15426]: listed object 75... 2026-02-13T08:06:17.622 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_15_[15426]: listed object 100... 2026-02-13T08:06:17.622 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_15_[15426]: listed object 125... 2026-02-13T08:06:17.622 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_15_[15426]: saw 150 objects 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_15_[15426]: shutting down. 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_16_[15427]: starting. 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_16_[15427]: added 25 objects... 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_16_[15427]: added half of the objects 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_16_[15427]: added 50 objects... 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_16_[15427]: added 50 objects 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: process_16_[15427]: shutting down. 2026-02-13T08:06:17.623 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.624 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.624 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.624 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.624 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******************************* 2026-02-13T08:06:17.624 INFO:tasks.workunit.client.0.trial119.stdout: list_parallel: ******* SUCCESS ********** 2026-02-13T08:06:17.625 INFO:tasks.workunit.client.0.trial119.stdout: handler_error: Running main() from gmock_main.cc 2026-02-13T08:06:17.625 INFO:tasks.workunit.client.0.trial119.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2026-02-13T08:06:17.625 INFO:tasks.workunit.client.0.trial119.stdout: handler_error: [----------] Global test environment set-up. 2026-02-13T08:06:17.625 INFO:tasks.workunit.client.0.trial119.stdout: handler_error: [----------] 1 test from neocls_handler_error 2026-02-13T08:06:17.625 INFO:tasks.workunit.client.0.trial119.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2026-02-13T08:06:17.625 INFO:tasks.workunit.client.0.trial119.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (2914 ms) 2026-02-13T08:06:17.625 INFO:tasks.workunit.client.0.trial119.stdout: handler_error: [----------] 1 test from neocls_handler_error (2914 ms total) 2026-02-13T08:06:17.625 INFO:tasks.workunit.client.0.trial119.stdout: handler_error: 2026-02-13T08:06:17.625 INFO:tasks.workunit.client.0.trial119.stdout: handler_error: [----------] Global test environment tear-down 2026-02-13T08:06:17.625 INFO:tasks.workunit.client.0.trial119.stdout: handler_error: [==========] 1 test from 1 test suite ran. (2914 ms total) 2026-02-13T08:06:17.625 INFO:tasks.workunit.client.0.trial119.stdout: handler_error: [ PASSED ] 1 test. 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: Running main() from gmock_main.cc 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [----------] Global test environment set-up. 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (95 ms) 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (5 ms) 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (3 ms) 2026-02-13T08:06:17.626 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (10 ms) 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (2 ms) 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (2 ms) 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (2 ms) 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (3 ms) 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (2 ms) 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2026-02-13T08:06:17.627 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (2 ms) 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (2 ms) 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (2 ms) 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (6 ms) 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (7 ms) 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (6 ms) 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (2 ms) 2026-02-13T08:06:17.628 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (159 ms total) 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [----------] Global test environment tear-down 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (2930 ms total) 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: Running main() from gmock_main.cc 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [----------] Global test environment set-up. 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (49 ms) 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (13 ms) 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2026-02-13T08:06:17.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (2876 ms) 2026-02-13T08:06:17.630 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (2939 ms total) 2026-02-13T08:06:17.630 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: 2026-02-13T08:06:17.630 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [----------] Global test environment tear-down 2026-02-13T08:06:17.630 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (2939 ms total) 2026-02-13T08:06:17.630 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2026-02-13T08:06:17.630 INFO:tasks.workunit.client.0.trial119.stdout: cls: Running main() from gmock_main.cc 2026-02-13T08:06:17.630 INFO:tasks.workunit.client.0.trial119.stdout: cls: [==========] Running 1 test from 1 test suite. 2026-02-13T08:06:17.630 INFO:tasks.workunit.client.0.trial119.stdout: cls: [----------] Global test environment set-up. 2026-02-13T08:06:17.631 INFO:tasks.workunit.client.0.trial119.stdout: cls: [----------] 1 test from NeoRadosCls 2026-02-13T08:06:17.631 INFO:tasks.workunit.client.0.trial119.stdout: cls: [ RUN ] NeoRadosCls.DNE 2026-02-13T08:06:17.631 INFO:tasks.workunit.client.0.trial119.stdout: cls: [ OK ] NeoRadosCls.DNE (2920 ms) 2026-02-13T08:06:17.631 INFO:tasks.workunit.client.0.trial119.stdout: cls: [----------] 1 test from NeoRadosCls (2920 ms total) 2026-02-13T08:06:17.631 INFO:tasks.workunit.client.0.trial119.stdout: cls: 2026-02-13T08:06:17.631 INFO:tasks.workunit.client.0.trial119.stdout: cls: [----------] Global test environment tear-down 2026-02-13T08:06:17.631 INFO:tasks.workunit.client.0.trial119.stdout: cls: [==========] 1 test from 1 test suite ran. (2920 ms total) 2026-02-13T08:06:17.631 INFO:tasks.workunit.client.0.trial119.stdout: cls: [ PASSED ] 1 test. 2026-02-13T08:06:17.641 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: Running main() from gmock_main.cc 2026-02-13T08:06:17.641 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2026-02-13T08:06:17.641 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [----------] Global test environment set-up. 2026-02-13T08:06:17.641 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2026-02-13T08:06:17.641 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (16 ms) 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (39 ms) 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (2886 ms) 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611313+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/3824985660' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial119-14516-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611358+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/2639071411' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_trial119-14531-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611396+0000 mon.a [INF] from='client.4448 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_trial119-14090-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611431+0000 mon.a [INF] from='client.4454 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_trial119-14098-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611459+0000 mon.a [INF] from='client.4463 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_trial119-14106-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:17.642 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611500+0000 mon.a [INF] from='client.4466 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_trial119-14114-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:17.643 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611541+0000 mon.a [INF] from='client.4487 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_trial119-14148-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:17.643 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611576+0000 mon.a [INF] from='client.4490 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_trial119-14167-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:17.643 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611611+0000 mon.a [INF] from='client.4493 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_trial119-14130-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:17.643 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611648+0000 mon.a [INF] from='client.4505 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial119-14241-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:17.643 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611682+0000 mon.a [INF] from='client.4514 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_trial119-14217-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:17.643 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611721+0000 mon.a [INF] from='client.4520 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_trial119-14258-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:18.627 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611759+0000 mon.a [INF] from='client.4526 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_trial119-14277-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:18.627 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611790+0000 mon.a [INF] from='client.4532 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_trial119-14304-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:18.627 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611819+0000 mon.a [INF] from='client.4535 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_trial119-14336-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:18.627 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611854+0000 mon.a [INF] from='client.4550 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_trial119-14350-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:18.627 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611886+0000 mon.a [INF] from='client.4613 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial119-14406-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:18.627 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:16.611918+0000 mon.a [INF] from='client.4619 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial119-14443-1","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.613510+0000 mon.a [INF] from='client.4568 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectstrial119-14754-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectstrial119-14754-1"}]': finished 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.613546+0000 mon.a [INF] from='client.4625 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritetrial119-14690-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritetrial119-14690-1"}]': finished 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.613569+0000 mon.a [INF] from='client.4544 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_trial119-14372-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_trial119-14372-1"}]': finished 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.637338+0000 client.admin [INF] onexx 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.637710+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/2800644203' entity='client.admin' cmd={"prefix":"log", "logtext":["onexx"]} : dispatch 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.647975+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/1671364269' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_trial119-14114-24"} : dispatch 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.649385+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/2988118387' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial119-14336-7"} : dispatch 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.650009+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/448451011' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial119-14304-7"} : dispatch 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.667673+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/706447086' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial119-14106-16"} : dispatch 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.672394+0000 mon.a [INF] from='client.4772 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_trial119-14114-24"} : dispatch 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.672514+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/706447086' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoEC_trial119-14106-16"} : dispatch 2026-02-13T08:06:18.628 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.672994+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/1671364269' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_trial119-14114-24"} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.685107+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/706447086' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_trial119-14106-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.685306+0000 mon.a [INF] from='client.4826 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial119-14336-7"} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.685834+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/2988118387' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial119-14336-7"} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.691718+0000 mon.a [INF] from='client.4841 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial119-14304-7"} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.692180+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/448451011' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial119-14304-7"} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.700121+0000 mon.a [INF] from='client.4772 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_trial119-14114-24"} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.700336+0000 mon.a [INF] from='client.4826 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_trial119-14336-7"} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.700497+0000 mon.a [INF] from='client.4841 ' entity='client.admin' cmd={"prefix": "osd crush rule rm", "name":"LibRadosStatEC_trial119-14304-7"} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.700614+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/1671364269' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_trial119-14114-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.700795+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/2988118387' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial119-14336-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.700830+0000 mon.a [INF] from='client.4772 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_trial119-14114-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-13T08:06:18.629 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.700966+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/448451011' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial119-14304-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-13T08:06:18.630 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.701143+0000 mon.a [INF] from='client.4826 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_trial119-14336-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-13T08:06:18.630 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:17.701276+0000 mon.a [INF] from='client.4841 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_trial119-14304-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-13T08:06:20.640 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:18.170756+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/371360005 delete_pools_parallel: process_1_[14661]: starting. 2026-02-13T08:06:20.641 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_1_[14661]: creating pool ceph_test_rados_delete_pools_parallel.trial119-14606 2026-02-13T08:06:20.641 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_1_[14661]: created object 0... 2026-02-13T08:06:20.641 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_1_[14661]: created object 25... 2026-02-13T08:06:20.641 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_1_[14661]: created object 49... 2026-02-13T08:06:20.641 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_1_[14661]: finishing. 2026-02-13T08:06:20.641 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_1_[14661]: shutting down. 2026-02-13T08:06:20.641 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_2_[14663]: starting. 2026-02-13T08:06:20.641 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_2_[14663]: deleting pool ceph_test_rados_delete_pools_parallel.trial119-14606 2026-02-13T08:06:20.641 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_2_[14663]: shutting down. 2026-02-13T08:06:20.641 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: ******************************* 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_3_[15504]: starting. 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_3_[15504]: creating pool ceph_test_rados_delete_pools_parallel.trial119-14606 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_3_[15504]: created object 0... 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_3_[15504]: created object 25... 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_3_[15504]: created object 49... 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_3_[15504]: finishing. 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_3_[15504]: shutting down. 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: ******************************* 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_5_[15506]: starting. 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_5_[15506]: listing objects. 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_5_[15506]: listed object 0... 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_5_[15506]: listed object 25... 2026-02-13T08:06:20.642 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_5_[15506]: saw 50 objects 2026-02-13T08:06:20.643 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_5_[15506]: shutting down. 2026-02-13T08:06:20.643 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: ******************************* 2026-02-13T08:06:20.643 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_4_[15505]: starting. 2026-02-13T08:06:20.643 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_4_[15505]: deleting pool ceph_test_rados_delete_pools_parallel.trial119-14606 2026-02-13T08:06:20.643 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: process_4_[15505]: shutting down. 2026-02-13T08:06:20.643 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: ******************************* 2026-02-13T08:06:20.643 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: ******************************* 2026-02-13T08:06:20.643 INFO:tasks.workunit.client.0.trial119.stdout: delete_pools_parallel: ******* SUCCESS ********** 2026-02-13T08:06:20.644 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_1_[14640]: starting. 2026-02-13T08:06:20.644 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_1_[14640]: creating pool ceph_test_rados_open_pools_parallel.trial119-14590 2026-02-13T08:06:20.644 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_1_[14640]: created object 0... 2026-02-13T08:06:20.644 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_1_[14640]: created object 25... 2026-02-13T08:06:20.644 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_1_[14640]: created object 49... 2026-02-13T08:06:20.644 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_1_[14640]: finishing. 2026-02-13T08:06:20.644 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_1_[14640]: shutting down. 2026-02-13T08:06:20.644 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_2_[14643]: starting. 2026-02-13T08:06:20.644 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_2_[14643]: rados_pool_create. 2026-02-13T08:06:20.644 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_2_[14643]: rados_ioctx_create. 2026-02-13T08:06:20.644 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_2_[14643]: shutting down. 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: ******************************* 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_3_[15507]: starting. 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_3_[15507]: creating pool ceph_test_rados_open_pools_parallel.trial119-14590 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_3_[15507]: created object 0... 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_3_[15507]: created object 25... 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_3_[15507]: created object 49... 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_3_[15507]: finishing. 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_3_[15507]: shutting down. 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: ******************************* 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_4_[15508]: starting. 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_4_[15508]: rados_pool_create. 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_4_[15508]: rados_ioctx_create. 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: process_4_[15508]: shutting down. 2026-02-13T08:06:20.645 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: ******************************* 2026-02-13T08:06:20.646 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: ******************************* 2026-02-13T08:06:20.646 INFO:tasks.workunit.client.0.trial119.stdout: open_pools_parallel: ******* SUCCESS ********** 2026-02-13T08:06:21.649 INFO:tasks.workunit.client.0.trial119.stdout: cmd: Running main() from gmock_main.cc 2026-02-13T08:06:21.649 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2026-02-13T08:06:21.649 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [----------] Global test environment set-up. 2026-02-13T08:06:21.649 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2026-02-13T08:06:21.649 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2026-02-13T08:06:21.649 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (1936 ms) 2026-02-13T08:06:21.649 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2026-02-13T08:06:21.650 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (1986 ms) 2026-02-13T08:06:21.650 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2026-02-13T08:06:21.650 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (3020 ms) 2026-02-13T08:06:21.650 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [----------] 3 tests from NeoRadosCmd (6943 ms total) 2026-02-13T08:06:21.650 INFO:tasks.workunit.client.0.trial119.stdout: cmd: 2026-02-13T08:06:21.650 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [----------] Global test environment tear-down 2026-02-13T08:06:21.650 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [==========] 3 tests from 1 test suite ran. (6943 ms total) 2026-02-13T08:06:21.650 INFO:tasks.workunit.client.0.trial119.stdout: cmd: [ PASSED ] 3 tests. 2026-02-13T08:06:21.697 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: Running main() from gmock_main.cc 2026-02-13T08:06:21.697 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [==========] Running 40 tests from 2 test suites. 2026-02-13T08:06:21.697 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [----------] Global test environment set-up. 2026-02-13T08:06:21.697 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP 2026-02-13T08:06:21.697 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: seed 14114 2026-02-13T08:06:21.697 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2026-02-13T08:06:21.697 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2026-02-13T08:06:21.697 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (125 ms) 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (4 ms) 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (1 ms) 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (220 ms) 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (1 ms) 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (1 ms) 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2026-02-13T08:06:21.698 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (2 ms) 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (1 ms) 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (2 ms) 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (2 ms) 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (1 ms) 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (2 ms) 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (1 ms) 2026-02-13T08:06:21.699 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (1 ms) 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (2 ms) 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (5 ms) 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (2 ms) 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CrcZeroWrite 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.CrcZeroWrite (1 ms) 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (2 ms) 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2026-02-13T08:06:21.700 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (1 ms) 2026-02-13T08:06:21.701 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2026-02-13T08:06:21.701 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (2 ms) 2026-02-13T08:06:21.701 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [----------] 22 tests from LibRadosIoPP (388 ms total) 2026-02-13T08:06:21.701 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: 2026-02-13T08:06:21.701 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP 2026-02-13T08:06:21.701 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2026-02-13T08:06:21.701 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1056 ms) 2026-02-13T08:06:21.701 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2026-02-13T08:06:21.701 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (5 ms) 2026-02-13T08:06:21.701 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2026-02-13T08:06:21.701 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (2 ms) 2026-02-13T08:06:22.685 INFO:tasks.workunit.client.0.trial119.stdout: api_2' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.0"} : dispatch 2026-02-13T08:06:22.686 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:18.171458+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/3713600052' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.1"} : dispatch 2026-02-13T08:06:22.686 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:18.171833+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/3713600052' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.2"} : dispatch 2026-02-13T08:06:22.686 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:18.172185+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/3713600052' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.3"} : dispatch 2026-02-13T08:06:22.686 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:18.172543+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/3713600052' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.4"} : dispatch 2026-02-13T08:06:22.686 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:18.172892+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/3713600052' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.5"} : dispatch 2026-02-13T08:06:22.686 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:18.173220+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/3713600052' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.6"} : dispatch 2026-02-13T08:06:22.686 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:18.173592+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/3713600052' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.7"} : dispatch 2026-02-13T08:06:22.686 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:18.173937+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/3713600052' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.8"} : dispatch 2026-02-13T08:06:22.686 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:18.174273+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/3713600052' entity='client.admin' cmd={"prefix": "pg deep-scrub", "pgid": "12.9"} : dispatch 2026-02-13T08:06:22.686 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:20.674506+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/650651138' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial119-14690-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-13T08:06:22.687 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:20.681970+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/2800644203' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2026-02-13T08:06:22.687 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.628932+0000 mon.a [INF] from='client.4544 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_trial119-14372-1"}]': finished 2026-02-13T08:06:22.687 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.628996+0000 mon.a [INF] from='client.4568 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectstrial119-14754-1"}]': finished 2026-02-13T08:06:22.687 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.629054+0000 mon.a [INF] from='client.4793 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_trial119-14098-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:22.687 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.629129+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/650651138' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOptrial119-14690-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-13T08:06:22.687 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.633439+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/2594608654' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial119-14098-3", "field": "max_bytes", "val": "4096"} : dispatch 2026-02-13T08:06:22.687 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.643565+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/650651138' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ReadOptrial119-14690-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOptrial119-14690-2"} : dispatch 2026-02-13T08:06:22.691 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.643680+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/2767155045' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial119-14241-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-13T08:06:22.691 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.643883+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/1062615422' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial119-14090-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-13T08:06:22.691 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.644067+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/1857974133' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial119-14516-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-13T08:06:22.691 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.644563+0000 mon.a [INF] from='client.4793 ' entity='client.admin' cmd={"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial119-14098-3", "field": "max_bytes", "val": "4096"} : dispatch 2026-02-13T08:06:22.691 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.645115+0000 mon.a [INF] from='client.5048 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial119-14241-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-13T08:06:22.691 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.645304+0000 mon.a [INF] from='client.5066 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "WaitForSafe_trial119-14090-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-13T08:06:22.691 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.645483+0000 mon.a [INF] from='client.5057 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "test-rados-api-trial119-14516-3","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-13T08:06:22.691 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.650383+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/1528968878' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial119-14754-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-13T08:06:22.691 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.650719+0000 mon.a [INF] from='client.5072 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial119-14754-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]} : dispatch 2026-02-13T08:06:22.691 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.720273+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/1671364269' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_trial119-14114-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2026-02-13T08:06:22.691 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:21.720450+0000 mon.a [INF] from='client.4772 ' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "LibRadosIoECPP_trial119-14114-24", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2026-02-13T08:06:22.692 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.631658+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/3603702315' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_trial119-14148-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_trial119-14148-10"}]': finished 2026-02-13T08:06:22.692 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.631708+0000 mon.a [INF] from='client.4886 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_trial119-14167-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_trial119-14167-10"}]': finished 2026-02-13T08:06:22.692 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.631746+0000 mon.a [INF] from='client.4793 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_trial119-14098-3", "field": "max_bytes", "val": "4096"}]': finished 2026-02-13T08:06:23.653 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.631778+0000 mon.a [INF] from='client.5048 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial119-14241-3","app": "rados","yes_i_really_mean_it": t list: Running main() from gmock_main.cc 2026-02-13T08:06:23.653 INFO:tasks.workunit.client.0.trial119.stdout: list: [==========] Running 3 tests from 1 test suite. 2026-02-13T08:06:23.653 INFO:tasks.workunit.client.0.trial119.stdout: list: [----------] Global test environment set-up. 2026-02-13T08:06:23.653 INFO:tasks.workunit.client.0.trial119.stdout: list: [----------] 3 tests from NeoradosList 2026-02-13T08:06:23.653 INFO:tasks.workunit.client.0.trial119.stdout: list: [ RUN ] NeoradosList.ListObjects 2026-02-13T08:06:23.654 INFO:tasks.workunit.client.0.trial119.stdout: list: [ OK ] NeoradosList.ListObjects (2919 ms) 2026-02-13T08:06:23.654 INFO:tasks.workunit.client.0.trial119.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2026-02-13T08:06:23.654 INFO:tasks.workunit.client.0.trial119.stdout: list: [ OK ] NeoradosList.ListObjectsNS (3002 ms) 2026-02-13T08:06:23.654 INFO:tasks.workunit.client.0.trial119.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2026-02-13T08:06:23.654 INFO:tasks.workunit.client.0.trial119.stdout: list: [ OK ] NeoradosList.ListObjectsMany (3016 ms) 2026-02-13T08:06:23.654 INFO:tasks.workunit.client.0.trial119.stdout: list: [----------] 3 tests from NeoradosList (8937 ms total) 2026-02-13T08:06:23.654 INFO:tasks.workunit.client.0.trial119.stdout: list: 2026-02-13T08:06:23.654 INFO:tasks.workunit.client.0.trial119.stdout: list: [----------] Global test environment tear-down 2026-02-13T08:06:23.654 INFO:tasks.workunit.client.0.trial119.stdout: list: [==========] 3 tests from 1 test suite ran. (8937 ms total) 2026-02-13T08:06:23.654 INFO:tasks.workunit.client.0.trial119.stdout: list: [ PASSED ] 3 tests. 2026-02-13T08:06:24.649 INFO:tasks.workunit.client.0.trial119.stdout: api_io: Running main() from gmock_main.cc 2026-02-13T08:06:24.649 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [----------] Global test environment set-up. 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [----------] 14 tests from LibRadosIo 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (121 ms) 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: no timeout :/ 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: no timeout :/ 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: no timeout :/ 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: no timeout :/ 2026-02-13T08:06:24.650 INFO:tasks.workunit.client.0.trial119.stdout: api_io: no timeout :/ 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (16 ms) 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (2 ms) 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.Checksum (1 ms) 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (2 ms) 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (2 ms) 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (2 ms) 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2026-02-13T08:06:24.651 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (0 ms) 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.TruncTest (2 ms) 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (2 ms) 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (1 ms) 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.RmXattr (5 ms) 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIo.XattrIter (3 ms) 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [----------] 14 tests from LibRadosIo (164 ms total) 2026-02-13T08:06:24.652 INFO:tasks.workunit.client.0.trial119.stdout: api_io: 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1054 ms) 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (2 ms) 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (2 ms) 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (2 ms) 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (3 ms) 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (1 ms) 2026-02-13T08:06:24.653 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2026-02-13T08:06:24.654 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (1 ms) 2026-02-13T08:06:24.654 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2026-02-13T08:06:24.654 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (1 ms) 2026-02-13T08:06:24.654 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2026-02-13T08:06:24.654 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (5 ms) 2026-02-13T08:06:24.654 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2026-02-13T08:06:24.654 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (2 ms) 2026-02-13T08:06:24.654 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1080 ms total) 2026-02-13T08:06:24.654 INFO:tasks.workunit.client.0.trial119.stdout: api_io: 2026-02-13T08:06:24.655 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [-------- api_stat_pp: Running main() from gmock_main.cc 2026-02-13T08:06:24.655 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2026-02-13T08:06:24.655 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [----------] Global test environment set-up. 2026-02-13T08:06:24.655 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2026-02-13T08:06:24.655 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: seed 14336 2026-02-13T08:06:24.655 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2026-02-13T08:06:24.655 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (98 ms) 2026-02-13T08:06:24.655 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2026-02-13T08:06:24.655 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (17 ms) 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (1 ms) 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (6 ms) 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (123 ms total) 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1056 ms) 2026-02-13T08:06:24.656 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (0 ms) 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (1 ms) 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (5 ms) 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1063 ms total) 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [----------] Global test environment tear-down 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (9977 ms total) 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_stat_pp: [ PASSED ] 9 tests. 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout:--] Global test environment tear-down 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [==========] 24 tests from 2 test suites ran. (10006 ms total) 2026-02-13T08:06:24.657 INFO:tasks.workunit.client.0.trial119.stdout: api_io: [ PASSED ] 24 tests. 2026-02-13T08:06:24.658 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: Running main() from gmock_main.cc 2026-02-13T08:06:24.658 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2026-02-13T08:06:24.658 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [----------] Global test environment set-up. 2026-02-13T08:06:24.658 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [----------] 5 tests from LibRadosStat 2026-02-13T08:06:24.658 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2026-02-13T08:06:24.658 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ OK ] LibRadosStat.Stat (125 ms) 2026-02-13T08:06:24.658 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (2 ms) 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ OK ] LibRadosStat.StatNS (4 ms) 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (1 ms) 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [----------] 5 tests from LibRadosStat (132 ms total) 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1054 ms) 2026-02-13T08:06:24.659 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2026-02-13T08:06:24.660 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (6 ms) 2026-02-13T08:06:24.660 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2026-02-13T08:06:24.660 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2026-02-13T08:06:24.660 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2026-02-13T08:06:24.660 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (1 ms) 2026-02-13T08:06:24.660 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1062 ms total) 2026-02-13T08:06:24.660 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: 2026-02-13T08:06:24.660 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [----------] Global test environment tear-down 2026-02-13T08:06:24.660 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (9985 ms total) 2026-02-13T08:06:24.660 INFO:tasks.workunit.client.0.trial119.stdout: api_stat: [ PASSED ] 9 tests. 2026-02-13T08:06:26.662 INFO:tasks.workunit.client.0.trial119.stdout: pool: Running main() from gmock_main.cc 2026-02-13T08:06:26.662 INFO:tasks.workunit.client.0.trial119.stdout: pool: [==========] Running 6 tests from 1 test suite. 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [----------] Global test environment set-up. 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [----------] 6 tests from NeoRadosPools 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ OK ] NeoRadosPools.PoolList (1919 ms) 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (1987 ms) 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (2011 ms) 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (2008 ms) 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2026-02-13T08:06:26.663 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2000 ms) 2026-02-13T08:06:26.664 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2026-02-13T08:06:26.664 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2004 ms) 2026-02-13T08:06:26.664 INFO:tasks.workunit.client.0.trial119.stdout: pool: [----------] 6 tests from NeoRadosPools (11932 ms total) 2026-02-13T08:06:26.664 INFO:tasks.workunit.client.0.trial119.stdout: pool: 2026-02-13T08:06:26.664 INFO:tasks.workunit.client.0.trial119.stdout: pool: [----------] Global test environment tear-down 2026-02-13T08:06:26.664 INFO:tasks.workunit.client.0.trial119.stdout: pool: [==========] 6 tests from 1 test suite ran. (11933 ms total) 2026-02-13T08:06:26.664 INFO:tasks.workunit.client.0.trial119.stdout: pool: [ PASSED ] 6 tests. 2026-02-13T08:06:26.699 INFO:tasks.workunit.client.0.trial119.stdout:rue}]': finished 2026-02-13T08:06:26.699 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.631811+0000 mon.a [INF] from='client.5066 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_trial119-14090-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:26.699 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.631841+0000 mon.a [INF] from='client.5057 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-trial119-14516-3","app": "rados","yes_i_really_mean_it": true}]': finished 2026-02-13T08:06:26.699 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.631880+0000 mon.a [INF] from='client.5072 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNStrial119-14754-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2026-02-13T08:06:26.699 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.631915+0000 mon.a [INF] from='client.4772 ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "LibRadosIoECPP_trial119-14114-24", "var": "allow_ec_overwrites", "val": "true"}]': finished 2026-02-13T08:06:26.699 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.634739+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/1528968878' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNStrial119-14754-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNStrial119-14754-2"} : dispatch 2026-02-13T08:06:26.699 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.641494+0000 mon.a [INF] from='client.5072 ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "ListObjectsNStrial119-14754-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNStrial119-14754-2"} : dispatch 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.641971+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/448451011' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial119-14304-7"} : dispatch 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.642229+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/706447086' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_trial119-14106-16"} : dispatch 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.642329+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/2289016491' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial119-14372-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.642993+0000 mon.c [INF] from='client.? v1:10.20.193.119:0/2988118387' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial119-14336-7"} : dispatch 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.643094+0000 mon.a [INF] from='client.4841 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_trial119-14304-7"} : dispatch 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.643215+0000 mon.a [INF] from='client.5081 ' entity='client.admin' cmd={"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_trial119-14372-4","app": "rados","yes_i_really_mean_it": true} : dispatch 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.643449+0000 mon.a [INF] from='client.4826 ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_trial119-14336-7"} : dispatch 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.682412+0000 client.admin [INF] threexx 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: got: 2026-02-13T08:06:22.682591+0000 mon.a [INF] from='client.? v1:10.20.193.119:0/2800644203' entity='client.admin' cmd={"prefix":"log", "logtext":["threexx"]} : dispatch 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (9077 ms) 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (12020 ms total) 2026-02-13T08:06:26.700 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: 2026-02-13T08:06:26.701 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [----------] Global test environment tear-down 2026-02-13T08:06:26.701 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (12020 ms total) 2026-02-13T08:06:26.701 INFO:tasks.workunit.client.0.trial119.stdout: api_cmd: [ PASSED ] 4 tests. 2026-02-13T08:06:27.571 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: Running main() from gmock_main.cc 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: [----------] Global test environment set-up. 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (5920 ms) 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (6935 ms) 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (12856 ms total) 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: [----------] Global test environment tear-down 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (12856 ms total) 2026-02-13T08:06:27.572 INFO:tasks.workunit.client.0.trial119.stdout: ec_io: [ PASSED ] 2 tests. 2026-02-13T08:06:27.638 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2026-02-13T08:06:27.638 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2026-02-13T08:06:27.638 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2026-02-13T08:06:27.638 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2026-02-13T08:06:27.638 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2026-02-13T08:06:27.638 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: notify 2026-02-13T08:06:27.638 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (1036 ms) 2026-02-13T08:06:27.638 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (3 ms) 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (1040 ms total) 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: notify 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (49 ms) 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: notify 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (3914 ms) 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2026-02-13T08:06:27.639 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (2 ms) 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (3 ms) 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: handle_notify cookie 94365016689808 notify_id 137438953476 notifier_gid 5081 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (3 ms) 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: handle_notify cookie 94365016689808 notify_id 137438953476 notifier_gid 5081 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (2 ms) 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: handle_notify cookie 94365016689808 notify_id 137438953477 notifier_gid 5081 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (4 ms) 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2026-02-13T08:06:27.640 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: handle_notify cookie 94365016694304 notify_id 137438953478 notifier_gid 5081 2026-02-13T08:06:27.641 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (3 ms) 2026-02-13T08:06:27.641 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2026-02-13T08:06:27.641 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: handle_notify cookie 94365016694304 notify_id 137438953479 notifier_gid 5081 2026-02-13T08:06:27.641 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (3 ms) 2026-02-13T08:06:27.641 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2026-02-13T08:06:27.641 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: handle_notify cookie 94365016694304 notify_id 137438953477 notifier_gid 5081 2026-02-13T08:06:27.641 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: handle_notify cookie 94365016694304 notify_id 137438953478 notifier_gid 5081 2026-02-13T08:06:27.641 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (4 ms) 2026-02-13T08:06:27.641 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2026-02-13T08:06:27.641 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: trying... 2026-02-13T08:06:28.579 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: handle_notify cookie 94365016689808 notify_id 137438953479 notifier_gi api_lock: Running main() from gmock_main.cc 2026-02-13T08:06:28.579 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [----------] Global test environment set-up. 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [----------] 8 tests from LibRadosLock 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (103 ms) 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLock.LockShared (18 ms) 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1028 ms) 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1005 ms) 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2026-02-13T08:06:28.580 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (2 ms) 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLock.Unlock (2 ms) 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (3 ms) 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (1 ms) 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [----------] 8 tests from LibRadosLock (2166 ms total) 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1036 ms) 2026-02-13T08:06:28.581 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (4 ms) 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1003 ms) 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1005 ms) 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (3 ms) 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (2 ms) 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (3 ms) 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2026-02-13T08:06:28.582 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (3 ms) 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3063 ms total) 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [----------] Global test environment tear-down 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (13922 ms total) 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock: [ PASSED ] 16 tests. 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: Running main() from gmock_main.cc 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [----------] Global test environment set-up. 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: seed 14167 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (122 ms) 2026-02-13T08:06:28.583 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (3 ms) 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1026 ms) 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1002 ms) 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (2 ms) 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (2 ms) 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (2 ms) 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2026-02-13T08:06:28.584 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (1 ms) 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2164 ms total) 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1044 ms) 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (6 ms) 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1002 ms) 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1006 ms) 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2026-02-13T08:06:28.585 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (2 ms) 2026-02-13T08:06:28.586 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2026-02-13T08:06:28.586 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (2 ms) 2026-02-13T08:06:28.586 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2026-02-13T08:06:28.586 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (3 ms) 2026-02-13T08:06:28.586 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2026-02-13T08:06:28.586 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (2 ms) 2026-02-13T08:06:28.586 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3070 ms total) 2026-02-13T08:06:28.586 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: 2026-02-13T08:06:28.586 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [----------] Global test environment tear-down 2026-02-13T08:06:28.586 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (13920 ms total) 2026-02-13T08:06:28.586 INFO:tasks.workunit.client.0.trial119.stdout: api_lock_pp: [ PASSED ] 16 tests. 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout:io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (2 ms) 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (1 ms) 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (2 ms) 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (2 ms) 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (1 ms) 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (2 ms) 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (1 ms) 2026-02-13T08:06:34.583 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (2 ms) 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (2 ms) 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (5 ms) 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CrcZeroWrite 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CrcZeroWrite (8868 ms) 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (1033 ms) 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (2 ms) 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (2 ms) 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (2 ms) 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [----------] 18 tests from LibRadosIoECPP (10999 ms total) 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [----------] Global test environment tear-down 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [==========] 40 tests from 2 test suites ran. (19935 ms total) 2026-02-13T08:06:34.584 INFO:tasks.workunit.client.0.trial119.stdout: api_io_pp: [ PASSED ] 40 tests. 2026-02-13T08:06:35.578 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: Running main() from gmock_main.cc 2026-02-13T08:06:35.579 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2026-02-13T08:06:35.579 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [----------] Global test environment set-up. 2026-02-13T08:06:35.579 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [----------] 3 tests from NeoradosECList 2026-02-13T08:06:35.579 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2026-02-13T08:06:35.579 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (6922 ms) 2026-02-13T08:06:35.579 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2026-02-13T08:06:35.579 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (6936 ms) 2026-02-13T08:06:35.579 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2026-02-13T08:06:35.579 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (7002 ms) 2026-02-13T08:06:35.579 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [----------] 3 tests from NeoradosECList (20862 ms total) 2026-02-13T08:06:35.580 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: 2026-02-13T08:06:35.580 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [----------] Global test environment tear-down 2026-02-13T08:06:35.580 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (20862 ms total) 2026-02-13T08:06:35.580 INFO:tasks.workunit.client.0.trial119.stdout: ec_list: [ PASSED ] 3 tests. 2026-02-13T08:06:35.582 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: Running main() from gmock_main.cc 2026-02-13T08:06:35.582 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2026-02-13T08:06:35.582 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [----------] Global test environment set-up. 2026-02-13T08:06:35.582 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2026-02-13T08:06:35.582 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2026-02-13T08:06:35.582 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify_test_cb 2026-02-13T08:06:35.582 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (112 ms) 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93980493094608 err -107 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1002 ms) 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93980493096880 err -107 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1003 ms) 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_cb from 4550 notify_id 98784247808 cookie 93980493240544 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (4 ms) 2026-02-13T08:06:35.583 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_cb from 4550 notify_id 98784247808 cookie 93980493384496 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (3 ms) 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_cb from 4550 notify_id 98784247808 cookie 93980493384496 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (3 ms) 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_cb from 4550 notify_id 98784247814 cookie 93980493384496 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_cb from 4550 notify_id 98784247814 cookie 93980493533984 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (3 ms) 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_cb from 4550 notify_id 98784247809 cookie 93980493533984 2026-02-13T08:06:35.584 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_cb from 4550 notify_id 103079215106 cookie 93980493533984 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3003 ms) 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93980493384496 err -107 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_cb from 4550 notify_id 133143986178 cookie 93980493537072 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5005 ms) 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify2_test_errcb cookie 93980493537072 err -107 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1003 ms) 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (11146 ms total) 2026-02-13T08:06:35.585 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: 2026-02-13T08:06:35.586 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2026-02-13T08:06:35.586 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2026-02-13T08:06:35.586 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: watch_notify_test_cb 2026-02-13T08:06:35.586 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1031 ms) 2026-02-13T08:06:35.586 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1031 ms total) 2026-02-13T08:06:35.586 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: 2026-02-13T08:06:35.586 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [----------] Global test environment tear-down 2026-02-13T08:06:35.586 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (20906 ms total) 2026-02-13T08:06:35.587 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify: [ PASSED ] 11 tests. 2026-02-13T08:06:36.594 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: Running main() from gmock_main.cc 2026-02-13T08:06:36.594 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2026-02-13T08:06:36.594 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [----------] Global test environment set-up. 2026-02-13T08:06:36.594 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2026-02-13T08:06:36.594 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2026-02-13T08:06:36.594 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2026-02-13T08:06:36.594 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2026-02-13T08:06:36.594 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: 2026-02-13T08:06:36.594 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (2941 ms) 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3008 ms) 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3010 ms) 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3004 ms) 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (2931 ms) 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (2988 ms) 2026-02-13T08:06:36.595 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2026-02-13T08:06:36.596 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (4014 ms) 2026-02-13T08:06:36.596 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (21901 ms total) 2026-02-13T08:06:36.596 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: 2026-02-13T08:06:36.596 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [----------] Global test environment tear-down 2026-02-13T08:06:36.596 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (21901 ms total) 2026-02-13T08:06:36.596 INFO:tasks.workunit.client.0.trial119.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2026-02-13T08:06:37.577 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: Running main() from gmock_main.cc 2026-02-13T08:06:37.577 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [==========] Running 6 tests from 2 test suites. 2026-02-13T08:06:37.578 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [----------] Global test environment set-up. 2026-02-13T08:06:37.578 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2026-02-13T08:06:37.578 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2026-02-13T08:06:37.578 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: handle_notify cookie 94872337979424 notify_id 90194313217 notifier_gid 4592 2026-02-13T08:06:37.578 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (2893 ms) 2026-02-13T08:06:37.578 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2026-02-13T08:06:37.578 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: Trying... 2026-02-13T08:06:37.578 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: handle_notify cookie 94872338714896 notify_id 103079215106 notifier_gid 4775 2026-02-13T08:06:37.578 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: Waiting for 3.000000000s 2026-02-13T08:06:37.578 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: Timed out. 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: Flushing... 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: Flushed... 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7026 ms) 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (9920 ms total) 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotify 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotify (2924 ms) 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyTimeout (4010 ms) 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WrongWatchType 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WrongWatchType (2999 ms) 2026-02-13T08:06:37.579 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ RUN ] NeoRadosWatchNotifyPoll.WatchNotifyCancel 2026-02-13T08:06:37.580 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ OK ] NeoRadosWatchNotifyPoll.WatchNotifyCancel (2991 ms) 2026-02-13T08:06:37.580 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [----------] 4 tests from NeoRadosWatchNotifyPoll (12925 ms total) 2026-02-13T08:06:37.580 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: 2026-02-13T08:06:37.580 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [----------] Global test environment tear-down 2026-02-13T08:06:37.580 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [==========] 6 tests from 2 test suites ran. (22846 ms total) 2026-02-13T08:06:37.580 INFO:tasks.workunit.client.0.trial119.stdout: watch_notify: [ PASSED ] 6 tests. 2026-02-13T08:06:38.589 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: Running main() from gmock_main.cc 2026-02-13T08:06:38.589 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [==========] Running 8 tests from 1 test suite. 2026-02-13T08:06:38.589 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [----------] Global test environment set-up. 2026-02-13T08:06:38.589 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps 2026-02-13T08:06:38.589 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2026-02-13T08:06:38.589 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (2892 ms) 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3013 ms) 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3014 ms) 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (3001 ms) 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (2932 ms) 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (2989 ms) 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2026-02-13T08:06:38.590 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (4007 ms) 2026-02-13T08:06:38.591 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Cancel 2026-02-13T08:06:38.591 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ OK ] NeoRadosWriteOps.Cancel (1994 ms) 2026-02-13T08:06:38.591 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [----------] 8 tests from NeoRadosWriteOps (23846 ms total) 2026-02-13T08:06:38.591 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: 2026-02-13T08:06:38.591 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [----------] Global test environment tear-down 2026-02-13T08:06:38.591 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [==========] 8 tests from 1 test suite ran. (23846 ms total) 2026-02-13T08:06:38.591 INFO:tasks.workunit.client.0.trial119.stdout: write_operations: [ PASSED ] 8 tests. 2026-02-13T08:06:39.599 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2026-02-13T08:06:39.599 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [----------] Global test environment set-up. 2026-02-13T08:06:39.599 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2026-02-13T08:06:39.599 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2026-02-13T08:06:39.599 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2026-02-13T08:06:39.599 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: 2026-02-13T08:06:14.774+0000 7fc214be3980 -1 failed for service _ceph-mon._tcp 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: 2026-02-13T08:06:14.774+0000 7fc214be3980 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (24 ms) 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (5004 ms) 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (5028 ms total) 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: 2026-02-13T08:06:39.600 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: started 0x557c4e4b2aa0 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: started 0x557c4e6bde30 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: started 2 aios 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: waiting 0x557c4e4b2aa0 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: waiting 0x557c4e6bde30 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: done. 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (5961 ms) 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (5961 ms total) 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2026-02-13T08:06:39.601 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMisc.Exec (32 ms) 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (3 ms) 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (2 ms) 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4962 ms) 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2026-02-13T08:06:39.602 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2026-02-13T08:06:39.603 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (6886 ms) 2026-02-13T08:06:39.603 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [----------] 8 tests from LibRadosMisc (11886 ms total) 2026-02-13T08:06:39.603 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: 2026-02-13T08:06:39.603 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [----------] Global test environment tear-down 2026-02-13T08:06:39.603 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (24916 ms total) 2026-02-13T08:06:39.603 INFO:tasks.workunit.client.0.trial119.stdout: api_misc: [ PASSED ] 12 tests. 2026-02-13T08:06:41.938 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2026-02-13T08:06:41.939 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [----------] Global test environment set-up. 2026-02-13T08:06:41.939 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [----------] 4 tests from LibRadosService 2026-02-13T08:06:41.939 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2026-02-13T08:06:41.939 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5045 ms) 2026-02-13T08:06:41.939 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2026-02-13T08:06:41.939 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [ OK ] LibRadosService.RegisterLate (29 ms) 2026-02-13T08:06:41.939 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2026-02-13T08:06:41.939 INFO:tasks.workunit.client.0.trial119.stdout: api_service: cluster: 2026-02-13T08:06:41.939 INFO:tasks.workunit.client.0.trial119.stdout: api_service: id: 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:41.939 INFO:tasks.workunit.client.0.trial119.stdout: api_service: health: HEALTH_OK 2026-02-13T08:06:41.939 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: services: 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: mon: 3 daemons, quorum a,c (age 7s) [leader: a], out of quorum: b 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: mgr: x(active, since 42s) 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: osd: 6 osds: 6 up (since 38s), 6 in (since 42s) 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: laundry: 2 daemons active (1 hosts) 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: data: 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: pools: 17 pools, 417 pgs 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: objects: 50 objects, 580 KiB 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: usage: 160 MiB used, 540 GiB / 540 GiB avail 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: pgs: 28.777% pgs unknown 2026-02-13T08:06:41.940 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 297 active+clean 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 120 unknown 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: io: 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: client: 1.8 KiB/s rd, 12 KiB/s wr, 30 op/s rd, 46 op/s wr 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: cluster: 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: id: 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: health: HEALTH_OK 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: services: 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: mon: 3 daemons, quorum a,c (age 9s) [leader: a], out of quorum: b 2026-02-13T08:06:41.941 INFO:tasks.workunit.client.0.trial119.stdout: api_service: mgr: x(active, since 44s) 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: osd: 6 osds: 6 up (since 40s), 6 in (since 44s) 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: laundry: 1 daemon active (1 hosts) 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: data: 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: pools: 22 pools, 649 pgs 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: objects: 43 objects, 580 KiB 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: usage: 160 MiB used, 540 GiB / 540 GiB avail 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: pgs: 69.029% pgs unknown 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 448 unknown 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 201 active+clean 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 2026-02-13T08:06:41.942 INFO:tasks.workunit.client.0.trial119.stdout: api_service: io: 2026-02-13T08:06:41.943 INFO:tasks.workunit.client.0.trial119.stdout: api_service: client: 2.7 KiB/s rd, 18 KiB/s wr, 43 op/s rd, 67 op/s wr 2026-02-13T08:06:41.943 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 2026-02-13T08:06:41.943 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 2026-02-13T08:06:41.943 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [ OK ] LibRadosService.StatusFormat (2136 ms) 2026-02-13T08:06:41.943 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [ RUN ] LibRadosService.Status 2026-02-13T08:06:41.943 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [ OK ] LibRadosService.Status (20032 ms) 2026-02-13T08:06:41.943 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [----------] 4 tests from LibRadosService (27244 ms total) 2026-02-13T08:06:41.943 INFO:tasks.workunit.client.0.trial119.stdout: api_service: 2026-02-13T08:06:41.943 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [----------] Global test environment tear-down 2026-02-13T08:06:41.943 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [==========] 4 tests from 1 test suite ran. (27244 ms total) 2026-02-13T08:06:41.943 INFO:tasks.workunit.client.0.trial119.stdout: api_service: [ PASSED ] 4 tests. 2026-02-13T08:06:43.591 INFO:tasks.workunit.client.0.trial119.stdout:d 5081 2026-02-13T08:06:43.592 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: timed out 2026-02-13T08:06:43.592 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: flushing 2026-02-13T08:06:43.592 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: flushed 2026-02-13T08:06:43.592 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3002 ms) 2026-02-13T08:06:43.592 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2026-02-13T08:06:43.592 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: trying... 2026-02-13T08:06:43.592 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: handle_notify cookie 94365016689808 notify_id 150323855368 notifier_gid 5081 2026-02-13T08:06:43.592 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: timed out 2026-02-13T08:06:43.592 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: flushing 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: flushed 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3007 ms) 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: List watches 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: notify2 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: handle_notify cookie 94365016689808 notify_id 163208757257 notifier_gid 5081 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: notify2 done 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: watch_check 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: unwatch2 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: flushing 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: done 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3010 ms) 2026-02-13T08:06:43.593 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: List watches 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: notify2 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: handle_notify cookie 94365016694224 notify_id 176093659141 notifier_gid 5081 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: notify2 done 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: watch_check 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: unwatch2 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: flushing 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: done 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3006 ms) 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (16020 ms total) 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2026-02-13T08:06:43.594 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (28911 ms total) 2026-02-13T08:06:43.595 INFO:tasks.workunit.client.0.trial119.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2026-02-13T08:06:44.856 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2026-02-13T08:06:44.856 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [----------] Global test environment set-up. 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5063 ms) 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (35 ms) 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20011 ms) 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: attempt 0 of 20 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5051 ms) 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (30162 ms total) 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: 2026-02-13T08:06:44.857 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [----------] Global test environment tear-down 2026-02-13T08:06:44.858 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (30162 ms total) 2026-02-13T08:06:44.858 INFO:tasks.workunit.client.0.trial119.stdout: api_service_pp: [ PASSED ] 4 tests. 2026-02-13T08:06:47.593 INFO:tasks.workunit.client.0.trial119.stdout: misc: Running main() from gmock_main.cc 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [==========] Running 12 tests from 1 test suite. 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [----------] Global test environment set-up. 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [----------] 12 tests from NeoRadosMisc 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.Version 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.Version (1922 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (1986 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.LongName (3022 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (2997 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (2925 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (3020 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.Exec (2982 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (3006 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (2996 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.BigObject (2998 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (2006 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (3004 ms) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [----------] 12 tests from NeoRadosMisc (32870 ms total) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [----------] Global test environment tear-down 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [==========] 12 tests from 1 test suite ran. (32870 ms total) 2026-02-13T08:06:47.594 INFO:tasks.workunit.client.0.trial119.stdout: misc: [ PASSED ] 12 tests. 2026-02-13T08:06:52.586 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: Running main() from gmock_main.cc 2026-02-13T08:06:52.586 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2026-02-13T08:06:52.586 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [----------] Global test environment set-up. 2026-02-13T08:06:52.586 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [----------] 9 tests from LibRadosPools 2026-02-13T08:06:52.586 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2026-02-13T08:06:52.586 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ OK ] LibRadosPools.PoolList (2968 ms) 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3005 ms) 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (3018 ms) 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3007 ms) 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (2937 ms) 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (4986 ms) 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2026-02-13T08:06:52.587 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (4993 ms) 2026-02-13T08:06:52.588 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2026-02-13T08:06:52.588 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5002 ms) 2026-02-13T08:06:52.588 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2026-02-13T08:06:52.588 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8000 ms) 2026-02-13T08:06:52.588 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [----------] 9 tests from LibRadosPools (37920 ms total) 2026-02-13T08:06:52.588 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: 2026-02-13T08:06:52.588 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [----------] Global test environment tear-down 2026-02-13T08:06:52.588 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (37920 ms total) 2026-02-13T08:06:52.588 INFO:tasks.workunit.client.0.trial119.stdout: api_pool: [ PASSED ] 9 tests. 2026-02-13T08:06:56.597 INFO:tasks.workunit.client.0.trial119.stdout: io: Running main() from gmock_main.cc 2026-02-13T08:06:56.598 INFO:tasks.workunit.client.0.trial119.stdout: io: [==========] Running 14 tests from 1 test suite. 2026-02-13T08:06:56.598 INFO:tasks.workunit.client.0.trial119.stdout: io: [----------] Global test environment set-up. 2026-02-13T08:06:56.598 INFO:tasks.workunit.client.0.trial119.stdout: io: [----------] 14 tests from NeoRadosIo 2026-02-13T08:06:56.598 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.Limits 2026-02-13T08:06:56.598 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.Limits (2913 ms) 2026-02-13T08:06:56.598 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2026-02-13T08:06:56.598 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (3012 ms) 2026-02-13T08:06:56.598 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2026-02-13T08:06:56.598 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.ReadOp (3017 ms) 2026-02-13T08:06:56.598 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2026-02-13T08:06:56.598 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.SparseRead (3001 ms) 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.RoundTrip (2930 ms) 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (2989 ms) 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3009 ms) 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (2996 ms) 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (3001 ms) 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.Trunc 2026-02-13T08:06:56.599 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.Trunc (3004 ms) 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.Remove 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.Remove (3001 ms) 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3006 ms) 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.RmXattr (2987 ms) 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3004 ms) 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [----------] 14 tests from NeoRadosIo (41877 ms total) 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [----------] Global test environment tear-down 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [==========] 14 tests from 1 test suite ran. (41877 ms total) 2026-02-13T08:06:56.600 INFO:tasks.workunit.client.0.trial119.stdout: io: [ PASSED ] 14 tests. 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: Running main() from gmock_main.cc 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [==========] Running 15 tests from 1 test suite. 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [----------] Global test environment set-up. 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (2904 ms) 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (3012 ms) 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3011 ms) 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2026-02-13T08:06:59.607 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (3001 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (2937 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (2984 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (3005 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (2998 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (3004 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (2998 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (3006 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3007 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (2986 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (3005 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ RUN ] NeoRadosReadOps.Cancel 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ OK ] NeoRadosReadOps.Cancel (3004 ms) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [----------] 15 tests from NeoRadosReadOps (44869 ms total) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [----------] Global test environment tear-down 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [==========] 15 tests from 1 test suite ran. (44869 ms total) 2026-02-13T08:06:59.608 INFO:tasks.workunit.client.0.trial119.stdout: read_operations: [ PASSED ] 15 tests. 2026-02-13T08:07:10.601 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: Running main() from gmock_main.cc 2026-02-13T08:07:10.601 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2026-02-13T08:07:10.601 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [----------] Global test environment set-up. 2026-02-13T08:07:10.601 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2026-02-13T08:07:10.601 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (2001 ms) 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (2009 ms) 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2011 ms) 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2000 ms) 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (8023 ms total) 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4044 ms) 2026-02-13T08:07:10.602 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (3986 ms) 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (4997 ms) 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (13029 ms total) 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (2999 ms) 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2004 ms) 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2026-02-13T08:07:10.603 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2003 ms) 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (1985 ms) 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (8993 ms total) 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4002 ms) 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4010 ms) 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8013 ms total) 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [----------] Global test environment tear-down 2026-02-13T08:07:10.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (55931 ms total) 2026-02-13T08:07:10.605 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots: [ PASSED ] 13 tests. 2026-02-13T08:07:10.606 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:10.606 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14601 2026-02-13T08:07:10.606 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14601 2026-02-13T08:07:10.606 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:10.606 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14429 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14429 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14317 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14317 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14186 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14186 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14358 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14358 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:10.607 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14664 2026-02-13T08:07:10.608 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14664 2026-02-13T08:07:10.608 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:10.608 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14679 2026-02-13T08:07:10.608 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14679 2026-02-13T08:07:10.608 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:10.608 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14210 2026-02-13T08:07:10.608 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14210 2026-02-13T08:07:23.590 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2026-02-13T08:07:23.590 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] Global test environment set-up. 2026-02-13T08:07:23.590 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2026-02-13T08:07:23.591 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2026-02-13T08:07:23.591 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2026-02-13T08:07:23.591 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2026-02-13T08:07:23.591 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: 2026-02-13T08:07:23.591 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2026-02-13T08:07:23.591 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: seed 14217 2026-02-13T08:07:23.591 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2026-02-13T08:07:23.591 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (0 ms) 2026-02-13T08:07:23.591 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2026-02-13T08:07:23.591 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (102 ms) 2026-02-13T08:07:23.591 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (17 ms) 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (3 ms) 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (4 ms) 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (1 ms) 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (0 ms) 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (1 ms) 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (0 ms) 2026-02-13T08:07:23.592 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (4 ms) 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (1 ms) 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (2 ms) 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (3 ms) 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: osd_max_attr_size = 0 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (1019 ms) 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2026-02-13T08:07:23.593 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (212 ms) 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: waiting for initial deep scrubs... 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: done waiting, doing copies 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: waiting for final deep scrubs... 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: done waiting 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60343 ms) 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (4 ms) 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (1 ms) 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4236 ms) 2026-02-13T08:07:23.594 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2026-02-13T08:07:23.595 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2026-02-13T08:07:23.595 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2026-02-13T08:07:23.595 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2026-02-13T08:07:23.595 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2026-02-13T08:07:23.595 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2026-02-13T08:07:24.589 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP (6 api_snapshots_pp: Running main() from gmock_main.cc 2026-02-13T08:07:24.589 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2026-02-13T08:07:24.589 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: seed 14277 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (2002 ms) 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (2008 ms) 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2012 ms) 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1999 ms) 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2026-02-13T08:07:24.590 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (3927 ms) 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (11950 ms total) 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4014 ms) 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3980 ms) 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6004 ms) 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4008 ms) 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2026-02-13T08:07:24.591 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2019 ms) 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: ./src/test/librados/snapshots_cxx.cc:460: Skipped 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_trial119-14277-7 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: waiting for snaps to purge 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17973 ms) 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (38001 ms total) 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: 2026-02-13T08:07:24.592 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (5 ms) 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (4999 ms) 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5005 ms total) 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3004 ms) 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (1990 ms) 2026-02-13T08:07:24.593 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2026-02-13T08:07:29.604 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2005 m snapshots: Running main() from gmock_main.cc 2026-02-13T08:07:29.604 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2026-02-13T08:07:29.604 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [----------] Global test environment set-up. 2026-02-13T08:07:29.604 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2026-02-13T08:07:29.604 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2026-02-13T08:07:29.604 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (4931 ms) 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (4990 ms) 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (3927 ms) 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (5004 ms) 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (7001 ms) 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (25855 ms total) 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2026-02-13T08:07:29.605 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (5001 ms) 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (6011 ms) 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (7996 ms) 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5996 ms) 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4006 ms) 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnaptrial119-14817-11. 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: Waiting for snaps to purge. 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19995 ms) 2026-02-13T08:07:29.606 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (49008 ms total) 2026-02-13T08:07:29.607 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: 2026-02-13T08:07:29.607 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [----------] Global test environment tear-down 2026-02-13T08:07:29.607 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (74863 ms total) 2026-02-13T08:07:29.607 INFO:tasks.workunit.client.0.trial119.stdout: snapshots: [ PASSED ] 11 tests. 2026-02-13T08:07:38.607 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: Running main() from gmock_main.cc 2026-02-13T08:07:38.607 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [==========] Running 45 tests from 2 test suites. 2026-02-13T08:07:38.607 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [----------] Global test environment set-up. 2026-02-13T08:07:38.607 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [----------] 29 tests from LibRadosAio 2026-02-13T08:07:38.607 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2026-02-13T08:07:38.607 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.TooBig (2983 ms) 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (3017 ms) 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (3013 ms) 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (2998 ms) 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (2938 ms) 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (2984 ms) 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3006 ms) 2026-02-13T08:07:38.608 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2026-02-13T08:07:38.609 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (2998 ms) 2026-02-13T08:07:38.609 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2026-02-13T08:07:38.609 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (3003 ms) 2026-02-13T08:07:38.609 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2026-02-13T08:07:38.609 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (3004 ms) 2026-02-13T08:07:38.609 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2026-02-13T08:07:38.609 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3001 ms) 2026-02-13T08:07:38.609 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2026-02-13T08:07:38.609 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (3005 ms) 2026-02-13T08:07:38.609 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2026-02-13T08:07:38.609 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (2986 ms) 2026-02-13T08:07:38.610 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2026-02-13T08:07:38.610 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3005 ms) 2026-02-13T08:07:38.610 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2026-02-13T08:07:38.610 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.Flush (3004 ms) 2026-02-13T08:07:38.610 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2026-02-13T08:07:38.610 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2990 ms) 2026-02-13T08:07:38.610 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2026-02-13T08:07:38.610 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3006 ms) 2026-02-13T08:07:38.610 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3005 ms) 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3004 ms) 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (2988 ms) 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3003 ms) 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3003 ms) 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2994 ms) 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3004 ms) 2026-02-13T08:07:38.611 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2026-02-13T08:07:38.612 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (2997 ms) 2026-02-13T08:07:38.612 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2026-02-13T08:07:38.612 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (2998 ms) 2026-02-13T08:07:38.612 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeSubmit 2026-02-13T08:07:38.612 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.CancelBeforeSubmit (3010 ms) 2026-02-13T08:07:38.612 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.CancelBeforeComplete 2026-02-13T08:07:42.939 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2026-02-13T08:07:42.939 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-13T08:07:42.939 DEBUG:teuthology.orchestra.run.trial119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-13T08:07:42.941 INFO:tasks.ceph.mon.b:Started 2026-02-13T08:07:42.942 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-13T08:07:42.942 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-13T08:07:42.942 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T08:07:52.110 INFO:tasks.workunit.client.0.trial119.stdout: apis) 2026-02-13T08:07:52.110 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2026-02-13T08:07:52.110 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2002 ms) 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (9002 ms total) 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4018 ms) 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (4001 ms) 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (8489 ms) 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (16509 ms total) 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: 2026-02-13T08:07:52.111 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2026-02-13T08:07:52.112 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (97439 ms total) 2026-02-13T08:07:52.112 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2026-02-13T08:07:52.112 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2026-02-13T08:07:52.112 INFO:tasks.workunit.client.0.trial119.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2026-02-13T08:07:53.994 INFO:tasks.workunit.client.0.trial119.stdout:5964 ms total) 2026-02-13T08:07:53.995 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: 2026-02-13T08:07:53.995 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2026-02-13T08:07:53.995 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2026-02-13T08:07:53.995 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (62 ms) 2026-02-13T08:07:53.995 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (62 ms total) 2026-02-13T08:07:53.995 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: 2026-02-13T08:07:53.995 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0,Checksummer::xxhash32,ceph_le > 2026-02-13T08:07:53.995 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (15 ms) 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (1 ms) 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (16 ms total) 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1,Checksummer::xxhash64,ceph_le > 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (11 ms) 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (1 ms) 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (13 ms total) 2026-02-13T08:07:53.996 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2,Checksummer::crc32c,ceph_le > 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (14 ms) 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (1 ms) 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (16 ms total) 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1008 ms) 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1008 ms total) 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: 2026-02-13T08:07:53.997 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [----------] Global test environment tear-down 2026-02-13T08:07:53.998 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (99324 ms total) 2026-02-13T08:07:53.998 INFO:tasks.workunit.client.0.trial119.stdout: api_misc_pp: [ PASSED ] 31 tests. 2026-02-13T08:07:53.999 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:53.999 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14612 2026-02-13T08:07:53.999 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14612 2026-02-13T08:07:53.999 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:53.999 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14101 2026-02-13T08:07:53.999 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14101 2026-02-13T08:07:53.999 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:53.999 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14140 2026-02-13T08:07:53.999 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14140 2026-02-13T08:07:54.000 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:54.000 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14548 2026-02-13T08:07:54.000 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14548 2026-02-13T08:07:54.000 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:07:54.000 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14093 2026-02-13T08:07:54.000 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14093 2026-02-13T08:07:57.943 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-13T08:07:57.944 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-13T08:07:57.944 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T08:07:57.944 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:07:58.015 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.004+0000 7fc524fac640 10 monclient: get_monmap_and_config 2026-02-13T08:07:58.015 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.004+0000 7fc524fac640 10 monclient: build_initial_monmap 2026-02-13T08:07:58.015 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.004+0000 7fc524fac640 10 monclient: monmap: 2026-02-13T08:07:58.015 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:58.015 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.016 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:07:58.011578+0000 2026-02-13T08:07:58.016 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:07:58.011578+0000 2026-02-13T08:07:58.016 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:58.016 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.016 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:58.016 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:07:58.016 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:07:58.016 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.018 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.004+0000 7fc524fac640 1 Processor -- start 2026-02-13T08:07:58.018 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 1 -- start start 2026-02-13T08:07:58.018 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 10 monclient: init 2026-02-13T08:07:58.018 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:58.018 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:07:58.018 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 10 monclient(hunting): picked mon.noname-b con 0x7fc52008e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:58.018 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 10 monclient(hunting): picked mon.noname-c con 0x7fc52008ef90 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:58.018 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 10 monclient(hunting): picked mon.noname-a con 0x7fc52017fe50 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:58.018 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc520089fa0 con 0x7fc52017fe50 2026-02-13T08:07:58.019 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc520089760 con 0x7fc52008ef90 2026-02-13T08:07:58.019 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc52008af90 con 0x7fc52008e4b0 2026-02-13T08:07:58.019 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc51e575640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fc52008e4b0 0x7fc52008e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57750/0 (socket says 10.20.193.104:57750) 2026-02-13T08:07:58.019 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc51e575640 1 -- 10.20.193.104:0/2291220485 learned_addr learned my addr 10.20.193.104:0/2291220485 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:58.019 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:58.019 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.008+0000 7fc524fac640 10 monclient(hunting): authenticate will time out at 583.600565s 2026-02-13T08:07:58.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 1 -- 10.20.193.104:0/2291220485 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909849175 0 0) 0x7fc520089fa0 con 0x7fc52017fe50 2026-02-13T08:07:58.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient(hunting): my global_id is 26865 2026-02-13T08:07:58.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 1 -- 10.20.193.104:0/2291220485 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc50c003620 con 0x7fc52017fe50 2026-02-13T08:07:58.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 1 -- 10.20.193.104:0/2291220485 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1582454607 0 0) 0x7fc50c003620 con 0x7fc52017fe50 2026-02-13T08:07:58.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 1 -- 10.20.193.104:0/2291220485 >> v1:10.20.193.104:6790/0 conn(0x7fc52008e4b0 legacy=0x7fc52008e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 1 -- 10.20.193.104:0/2291220485 >> v1:10.20.193.119:6789/0 conn(0x7fc52008ef90 legacy=0x7fc52017e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient: _finish_hunting 0 2026-02-13T08:07:58.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 1 monclient: found mon.noname-a 2026-02-13T08:07:58.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 1 -- 10.20.193.104:0/2291220485 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52008b270 con 0x7fc52017fe50 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient: _finish_auth 0 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient: _check_auth_tickets 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 1 -- 10.20.193.104:0/2291220485 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc510003180 con 0x7fc52017fe50 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient: dump: 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.046 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc524fac640 5 monclient: authenticate success, global_id 26865 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc524fac640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 1 -- 10.20.193.104:0/2291220485 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc510003400 con 0x7fc52017fe50 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:58.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 1 -- 10.20.193.104:0/2291220485 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc510003840 con 0x7fc52017fe50 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc51d573640 10 monclient: dump: 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.048 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc524fac640 10 monclient: get_monmap_and_config success 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.028+0000 7fc524fac640 4 set_mon_vals no callback set 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: shutdown 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- 10.20.193.104:0/2291220485 >> v1:10.20.193.104:6789/0 conn(0x7fc52017fe50 legacy=0x7fc5201a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- 10.20.193.104:0/2291220485 shutdown_connections 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- 10.20.193.104:0/2291220485 >> 10.20.193.104:0/2291220485 conn(0x7fc520051e80 msgr2=0x7fc52008c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- 10.20.193.104:0/2291220485 shutdown_connections 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- 10.20.193.104:0/2291220485 wait complete. 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: build_initial_monmap 2026-02-13T08:07:58.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: monmap: 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 librados: starting msgr at 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 librados: starting objecter 2026-02-13T08:07:58.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 Processor -- start 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- start start 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 librados: setting wanted keys 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 librados: calling monclient init 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: init 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient(hunting): picked mon.noname-c con 0x7fc52008e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient(hunting): picked mon.noname-a con 0x7fc52008ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient(hunting): picked mon.noname-b con 0x7fc52017fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc52007ecc0 con 0x7fc52008ef90 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc52007efa0 con 0x7fc52017fe50 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc52007e130 con 0x7fc52008e4b0 2026-02-13T08:07:58.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient(hunting): authenticate will time out at 583.625732s 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc51e575640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fc52008e4b0 0x7fc52007b180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57762/0 (socket says 10.20.193.104:57762) 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc51e575640 1 -- 10.20.193.104:0/1119846858 learned_addr learned my addr 10.20.193.104:0/1119846858 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 client.?.objecter ms_handle_connect 0x7fc52008e4b0 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 client.?.objecter ms_handle_connect 0x7fc52008ef90 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3921844879 0 0) 0x7fc52007ecc0 con 0x7fc52008ef90 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient(hunting): my global_id is 26868 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4ec003620 con 0x7fc52008ef90 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3455782772 0 0) 0x7fc4ec003620 con 0x7fc52008ef90 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc52007ecc0 con 0x7fc52008ef90 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 client.?.objecter ms_handle_connect 0x7fc52017fe50 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc5080030a0 con 0x7fc52008ef90 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient(hunting): dump: 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.053 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2565259799 0 0) 0x7fc52007ecc0 con 0x7fc52008ef90 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 >> v1:10.20.193.104:6790/0 conn(0x7fc52008e4b0 legacy=0x7fc52007b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 >> v1:10.20.193.119:6789/0 conn(0x7fc52017fe50 legacy=0x7fc520170840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:07:58.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 monclient: found mon.a 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52007cc40 con 0x7fc52008ef90 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient: _finish_auth 0 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 5 monclient: authenticate success, global_id 26868 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: _renew_subs 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- 10.20.193.104:0/1119846858 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc52007e700 con 0x7fc52008ef90 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 client.26868.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: _renew_subs 2026-02-13T08:07:58.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- 10.20.193.104:0/1119846858 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc52007d9d0 con 0x7fc52008ef90 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 librados: init done 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc508003450 con 0x7fc52008ef90 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc508003ba0 con 0x7fc52008ef90 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 monclient: dump: 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.056 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc51cd72640 4 set_mon_vals no callback set 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fc508003d40 con 0x7fc52008ef90 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(114..114 src has 1..114) ==== 5914+0+0 (unknown 3523904086 0 0) 0x7fc508049990 con 0x7fc52008ef90 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 client.26868.objecter ms_dispatch2 0x7fc520000ba0 osd_map(114..114 src has 1..114) 2026-02-13T08:07:58.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 3 client.26868.objecter handle_osd_map got epochs [114,114] > 0 2026-02-13T08:07:58.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 3 client.26868.objecter handle_osd_map decoding full epoch 114 2026-02-13T08:07:58.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc524fac640 1 -- 10.20.193.104:0/1119846858 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc520061860 con 0x7fc52008ef90 2026-02-13T08:07:58.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 20 client.26868.objecter dump_active .. 0 homeless 2026-02-13T08:07:58.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc51e575640 10 monclient: get_auth_request con 0x7fc4ec03b800 auth_method 0 2026-02-13T08:07:58.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.032+0000 7fc506ffd640 10 client.26868.objecter ms_handle_connect 0x7fc4ec03b800 2026-02-13T08:07:58.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.036+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7fc508015a40 con 0x7fc52008ef90 2026-02-13T08:07:58.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.036+0000 7fc506ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.036+0000 7fc506ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:07:58.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:07:58.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:07:58.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 1 -- 10.20.193.104:0/1119846858 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc52008cc70 con 0x7fc52008ef90 2026-02-13T08:07:58.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc506ffd640 1 -- 10.20.193.104:0/1119846858 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1475 (unknown 254746657 0 2213016206) 0x7fc5080495d0 con 0x7fc52008ef90 2026-02-13T08:07:58.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc506ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:07:58.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc506ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:07:58.158 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:07:58.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 10 librados: watch_flush enter 2026-02-13T08:07:58.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 10 librados: watch_flush exit 2026-02-13T08:07:58.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 20 client.26868.objecter shutdown clearing up homeless session... 2026-02-13T08:07:58.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 10 client.26868.objecter successfully canceled tick 2026-02-13T08:07:58.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 1 -- 10.20.193.104:0/1119846858 >> v1:10.20.193.119:6812/276487904 conn(0x7fc4ec03b800 legacy=0x7fc4ec05bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 10 monclient: shutdown 2026-02-13T08:07:58.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:58.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 1 -- 10.20.193.104:0/1119846858 >> v1:10.20.193.104:6789/0 conn(0x7fc52008ef90 legacy=0x7fc52007b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 1 -- 10.20.193.104:0/1119846858 shutdown_connections 2026-02-13T08:07:58.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 1 -- 10.20.193.104:0/1119846858 >> 10.20.193.104:0/1119846858 conn(0x7fc520051e80 msgr2=0x7fc520085020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:58.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 1 -- 10.20.193.104:0/1119846858 shutdown_connections 2026-02-13T08:07:58.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 1 -- 10.20.193.104:0/1119846858 wait complete. 2026-02-13T08:07:58.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.148+0000 7fc524fac640 1 librados: shutdown 2026-02-13T08:07:58.168 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T08:07:58.168 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T08:07:58.169 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T08:07:58.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.224+0000 7f34b76ad640 10 monclient: get_monmap_and_config 2026-02-13T08:07:58.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.224+0000 7f34b76ad640 10 monclient: build_initial_monmap 2026-02-13T08:07:58.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.224+0000 7f34b76ad640 10 monclient: monmap: 2026-02-13T08:07:58.235 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:58.236 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.236 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:07:58.231718+0000 2026-02-13T08:07:58.236 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:07:58.231718+0000 2026-02-13T08:07:58.236 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:58.236 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.236 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:58.236 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:07:58.236 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:07:58.236 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 Processor -- start 2026-02-13T08:07:58.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- start start 2026-02-13T08:07:58.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: init 2026-02-13T08:07:58.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:58.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:07:58.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient(hunting): picked mon.noname-a con 0x7f34b0091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:58.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient(hunting): picked mon.noname-b con 0x7f34b013f870 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:58.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient(hunting): picked mon.noname-c con 0x7f34b013fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:58.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b008e5f0 con 0x7f34b0091740 2026-02-13T08:07:58.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b008e8d0 con 0x7f34b013fcd0 2026-02-13T08:07:58.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b008ebb0 con 0x7f34b013f870 2026-02-13T08:07:58.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:58.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient(hunting): authenticate will time out at 583.820507s 2026-02-13T08:07:58.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b5422640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f34b0091740 0x7f34b013f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:43898/0 (socket says 10.20.193.104:43898) 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b5422640 1 -- 10.20.193.104:0/230754991 learned_addr learned my addr 10.20.193.104:0/230754991 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b4c21640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f34b013f870 0x7f34b0180690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57766/0 (socket says 10.20.193.104:57766) 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 -- 10.20.193.104:0/230754991 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 415308491 0 0) 0x7f34b008e5f0 con 0x7f34b0091740 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient(hunting): my global_id is 26871 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 -- 10.20.193.104:0/230754991 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3498003620 con 0x7f34b0091740 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 -- 10.20.193.104:0/230754991 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 442162979 0 0) 0x7f34b008ebb0 con 0x7f34b013f870 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient(hunting): my global_id is 27236 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 -- 10.20.193.104:0/230754991 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34b008e5f0 con 0x7f34b013f870 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 -- 10.20.193.104:0/230754991 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3327380508 0 0) 0x7f3498003620 con 0x7f34b0091740 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 -- 10.20.193.104:0/230754991 >> v1:10.20.193.104:6790/0 conn(0x7f34b013f870 legacy=0x7f34b0180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 -- 10.20.193.104:0/230754991 >> v1:10.20.193.119:6789/0 conn(0x7f34b013fcd0 legacy=0x7f34b01a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient: _finish_hunting 0 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 monclient: found mon.noname-a 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 -- 10.20.193.104:0/230754991 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b0091b10 con 0x7f34b0091740 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient: _finish_auth 0 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient: _check_auth_tickets 2026-02-13T08:07:58.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 -- 10.20.193.104:0/230754991 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f34a0002e00 con 0x7f34b0091740 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient: dump: 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.249 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 5 monclient: authenticate success, global_id 26871 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 -- 10.20.193.104:0/230754991 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34a0003050 con 0x7f34b0091740 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 1 -- 10.20.193.104:0/230754991 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f34a0003490 con 0x7f34b0091740 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349ffff640 10 monclient: dump: 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.250 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: get_monmap_and_config success 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 4 set_mon_vals no callback set 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: shutdown 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- 10.20.193.104:0/230754991 >> v1:10.20.193.104:6789/0 conn(0x7f34b0091740 legacy=0x7f34b013f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- 10.20.193.104:0/230754991 shutdown_connections 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- 10.20.193.104:0/230754991 >> 10.20.193.104:0/230754991 conn(0x7f34b0090810 msgr2=0x7f34b0090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- 10.20.193.104:0/230754991 shutdown_connections 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- 10.20.193.104:0/230754991 wait complete. 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: build_initial_monmap 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: monmap: 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.252 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 librados: starting msgr at 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 librados: starting objecter 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 Processor -- start 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- start start 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 librados: setting wanted keys 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 librados: calling monclient init 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: init 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:58.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient(hunting): picked mon.noname-c con 0x7f34b0091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient(hunting): picked mon.noname-b con 0x7f34b013f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient(hunting): picked mon.noname-a con 0x7f34b013fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b012fa30 con 0x7f34b013fcd0 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b012cd10 con 0x7f34b013f870 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34b012fd10 con 0x7f34b0091740 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient(hunting): authenticate will time out at 583.822972s 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b5422640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f34b0091740 0x7f34b012bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57782/0 (socket says 10.20.193.104:57782) 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b5422640 1 -- 10.20.193.104:0/1646290550 learned_addr learned my addr 10.20.193.104:0/1646290550 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 client.?.objecter ms_handle_connect 0x7f34b0091740 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 client.?.objecter ms_handle_connect 0x7f34b013fcd0 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870105670 0 0) 0x7f34b012fd10 con 0x7f34b0091740 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): my global_id is 27239 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3480003620 con 0x7f34b0091740 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 client.?.objecter ms_handle_connect 0x7f34b013f870 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289650518 0 0) 0x7f34b012fa30 con 0x7f34b013fcd0 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): my global_id is 26874 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34b012fd10 con 0x7f34b013fcd0 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2815685664 0 0) 0x7f3480003620 con 0x7f34b0091740 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34b012fa30 con 0x7f34b0091740 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f34a00033a0 con 0x7f34b0091740 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): dump: 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.256 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985412031 0 0) 0x7f34b012cd10 con 0x7f34b013f870 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): my global_id is 74107 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3480003620 con 0x7f34b013f870 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1405353893 0 0) 0x7f34b012fd10 con 0x7f34b013fcd0 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34b012cd10 con 0x7f34b013fcd0 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f34ac0033a0 con 0x7f34b013fcd0 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient(hunting): dump: 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.258 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.259 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.259 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.259 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.259 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4163492731 0 0) 0x7f34b012fa30 con 0x7f34b0091740 2026-02-13T08:07:58.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 >> v1:10.20.193.119:6789/0 conn(0x7f34b013f870 legacy=0x7f34b012c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 >> v1:10.20.193.104:6789/0 conn(0x7f34b013fcd0 legacy=0x7f34b01919d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient: _finish_hunting 0 2026-02-13T08:07:58.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 monclient: found mon.c 2026-02-13T08:07:58.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:58.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b0059140 con 0x7f34b0091740 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient: _finish_auth 0 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient: _check_auth_tickets 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 5 monclient: authenticate success, global_id 27239 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: _renew_subs 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f34b008ab30 con 0x7f34b0091740 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 client.27239.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: _renew_subs 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f34b012f750 con 0x7f34b0091740 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 librados: init done 2026-02-13T08:07:58.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34a0003030 con 0x7f34b0091740 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f34a0004cf0 con 0x7f34b0091740 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349f7fe640 4 set_mon_vals no callback set 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 monclient: dump: 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.261 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f34b76ad640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f34b01301f0 con 0x7f34b0088990 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 client.27239.objecter ms_handle_connect 0x7f34b0088990 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.228+0000 7f349dffb640 10 client.27239.objecter resend_mon_ops 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1980613643 0 0) 0x7f34b01301f0 con 0x7f34b0088990 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 10 monclient(hunting): my global_id is 26877 2026-02-13T08:07:58.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34b012fa30 con 0x7f34b0088990 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4226241525 0 0) 0x7f34b012fa30 con 0x7f34b0088990 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34b01301f0 con 0x7f34b0088990 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f34a4002880 con 0x7f34b0088990 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 10 monclient: dump: 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.263 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f34a0010d00 con 0x7f34b0091740 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(115..115 src has 1..115) ==== 5914+0+0 (unknown 2301697532 0 0) 0x7f34a004aac0 con 0x7f34b0091740 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 10 client.27239.objecter ms_dispatch2 0x7f34b0000ba0 osd_map(115..115 src has 1..115) 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 3 client.27239.objecter handle_osd_map got epochs [115,115] > 0 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 3 client.27239.objecter handle_osd_map decoding full epoch 115 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 20 client.27239.objecter dump_active .. 0 homeless 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4195214289 0 0) 0x7f34b01301f0 con 0x7f34b0088990 2026-02-13T08:07:58.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34b0061860 con 0x7f34b0088990 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f34b5c23640 10 monclient: get_auth_request con 0x7f348003b9e0 auth_method 0 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f34a4002a90 con 0x7f34b0088990 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 >> v1:10.20.193.104:6789/0 conn(0x7f34b0088990 legacy=0x7f34b004ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 >> v1:10.20.193.104:6789/0 conn(0x7f34b0088990 legacy=0x7f34b004ca00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f349dffb640 10 client.27239.objecter ms_handle_connect 0x7f348003b9e0 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f34b76ad640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.232+0000 7f34b76ad640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f34b004d110 con 0x7f34b0088d60 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 10 client.27239.objecter ms_handle_connect 0x7f34b0088d60 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 10 client.27239.objecter resend_mon_ops 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330027338 0 0) 0x7f34b004d110 con 0x7f34b0088d60 2026-02-13T08:07:58.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 10 monclient(hunting): my global_id is 26880 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34b01301f0 con 0x7f34b0088d60 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1960506464 0 0) 0x7f34b01301f0 con 0x7f34b0088d60 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34b004d110 con 0x7f34b0088d60 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f34a4004c70 con 0x7f34b0088d60 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 10 monclient: dump: 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.266 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 862348404 0 0) 0x7f34b004d110 con 0x7f34b0088d60 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 --> v1:10.20.193.104:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f34b012e770 con 0x7f34b0088d60 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4327 (unknown 0 0 1051608351) 0x7f34a40060f0 con 0x7f34b0088d60 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:07:58.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:07:58.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 >> v1:10.20.193.104:6789/0 conn(0x7f34b0088d60 legacy=0x7f34b0194100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f349dffb640 1 -- 10.20.193.104:0/1646290550 >> v1:10.20.193.104:6789/0 conn(0x7f34b0088d60 legacy=0x7f34b0194100 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:07:58.268 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:07:58.268 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:07:58.268 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:07:58.268 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:07:58.268 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 22, 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 147647, 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:07:58.269 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:07:58.270 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.271 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:07:58.272 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:07:58.273 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:07:58.274 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.275 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:07:58.276 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.277 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: "num": 2 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.278 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:07:58.279 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:07:58.279 INFO:teuthology.orchestra.run.trial104.stdout: "num": 3 2026-02-13T08:07:58.279 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.279 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.279 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.279 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:07:58.279 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:07:58.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 10 librados: watch_flush enter 2026-02-13T08:07:58.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 10 librados: watch_flush exit 2026-02-13T08:07:58.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 20 client.27239.objecter shutdown clearing up homeless session... 2026-02-13T08:07:58.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 10 client.27239.objecter successfully canceled tick 2026-02-13T08:07:58.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 1 -- 10.20.193.104:0/1646290550 >> v1:10.20.193.119:6812/276487904 conn(0x7f348003b9e0 legacy=0x7f348005be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 10 monclient: shutdown 2026-02-13T08:07:58.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:58.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 1 -- 10.20.193.104:0/1646290550 >> v1:10.20.193.104:6790/0 conn(0x7f34b0091740 legacy=0x7f34b012bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b5c23640 1 -- 10.20.193.104:0/1646290550 reap_dead start 2026-02-13T08:07:58.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 1 -- 10.20.193.104:0/1646290550 shutdown_connections 2026-02-13T08:07:58.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 1 -- 10.20.193.104:0/1646290550 >> 10.20.193.104:0/1646290550 conn(0x7f34b0090810 msgr2=0x7f34b0057f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:58.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 1 -- 10.20.193.104:0/1646290550 shutdown_connections 2026-02-13T08:07:58.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 1 -- 10.20.193.104:0/1646290550 wait complete. 2026-02-13T08:07:58.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.236+0000 7f34b76ad640 1 librados: shutdown 2026-02-13T08:07:58.281 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:07:58.281 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T08:07:58.282 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T08:07:58.339 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: get_monmap_and_config 2026-02-13T08:07:58.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: build_initial_monmap 2026-02-13T08:07:58.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: monmap: 2026-02-13T08:07:58.340 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:58.340 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.340 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:07:58.336120+0000 2026-02-13T08:07:58.340 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:07:58.336120+0000 2026-02-13T08:07:58.340 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:58.340 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.340 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:58.340 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:07:58.340 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:07:58.341 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 Processor -- start 2026-02-13T08:07:58.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- start start 2026-02-13T08:07:58.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: init 2026-02-13T08:07:58.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:58.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:07:58.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient(hunting): picked mon.noname-c con 0x7fba48139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:58.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient(hunting): picked mon.noname-a con 0x7fba4815e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:58.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient(hunting): picked mon.noname-b con 0x7fba4817fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4813aa00 con 0x7fba4815e200 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba4808ba20 con 0x7fba48139f20 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba48089e30 con 0x7fba4817fd00 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient(hunting): authenticate will time out at 583.924961s 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba46d76640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fba4817fd00 0x7fba481a00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57798/0 (socket says 10.20.193.104:57798) 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45d74640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fba4815e200 0x7fba4817e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:43942/0 (socket says 10.20.193.104:43942) 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba46d76640 1 -- 10.20.193.104:0/3796750229 learned_addr learned my addr 10.20.193.104:0/3796750229 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3208065727 0 0) 0x7fba30002920 con 0x7fba4815e200 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): my global_id is 26883 2026-02-13T08:07:58.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba34003620 con 0x7fba4815e200 2026-02-13T08:07:58.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3309935768 0 0) 0x7fba48089e30 con 0x7fba4817fd00 2026-02-13T08:07:58.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): my global_id is 27242 2026-02-13T08:07:58.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba30002920 con 0x7fba4817fd00 2026-02-13T08:07:58.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1447278646 0 0) 0x7fba4808ba20 con 0x7fba48139f20 2026-02-13T08:07:58.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient(hunting): my global_id is 74110 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba48089e30 con 0x7fba48139f20 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2435552585 0 0) 0x7fba34003620 con 0x7fba4815e200 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 >> v1:10.20.193.104:6790/0 conn(0x7fba4817fd00 legacy=0x7fba481a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 >> v1:10.20.193.119:6789/0 conn(0x7fba48139f20 legacy=0x7fba4813a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient: _finish_hunting 0 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 monclient: found mon.noname-a 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4808a380 con 0x7fba4815e200 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient: _finish_auth 0 2026-02-13T08:07:58.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient: _check_auth_tickets 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fba30002fd0 con 0x7fba4815e200 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient: dump: 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.354 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 5 monclient: authenticate success, global_id 26883 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba30003170 con 0x7fba4815e200 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 1 -- 10.20.193.104:0/3796750229 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fba300048e0 con 0x7fba4815e200 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba45573640 10 monclient: dump: 2026-02-13T08:07:58.355 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: get_monmap_and_config success 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 4 set_mon_vals no callback set 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: shutdown 2026-02-13T08:07:58.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:58.357 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- 10.20.193.104:0/3796750229 >> v1:10.20.193.104:6789/0 conn(0x7fba4815e200 legacy=0x7fba4817e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.357 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- 10.20.193.104:0/3796750229 shutdown_connections 2026-02-13T08:07:58.357 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- 10.20.193.104:0/3796750229 >> 10.20.193.104:0/3796750229 conn(0x7fba48051a50 msgr2=0x7fba48051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:58.357 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- 10.20.193.104:0/3796750229 shutdown_connections 2026-02-13T08:07:58.357 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- 10.20.193.104:0/3796750229 wait complete. 2026-02-13T08:07:58.357 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: build_initial_monmap 2026-02-13T08:07:58.357 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: monmap: 2026-02-13T08:07:58.357 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:58.357 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:07:58.357 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:07:58.357 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 librados: starting msgr at 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 librados: starting objecter 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 Processor -- start 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- start start 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 librados: setting wanted keys 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 librados: calling monclient init 2026-02-13T08:07:58.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: init 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient(hunting): picked mon.noname-b con 0x7fba48139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient(hunting): picked mon.noname-c con 0x7fba4815e200 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient(hunting): picked mon.noname-a con 0x7fba4817fd00 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba481640c0 con 0x7fba4817fd00 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba48162680 con 0x7fba48139f20 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba48164690 con 0x7fba4815e200 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient(hunting): authenticate will time out at 583.927087s 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba46d76640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fba4817fd00 0x7fba48126aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:43958/0 (socket says 10.20.193.104:43958) 2026-02-13T08:07:58.359 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba46d76640 1 -- 10.20.193.104:0/2266003056 learned_addr learned my addr 10.20.193.104:0/2266003056 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 client.?.objecter ms_handle_connect 0x7fba4817fd00 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 client.?.objecter ms_handle_connect 0x7fba4815e200 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 485158104 0 0) 0x7fba481640c0 con 0x7fba4817fd00 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): my global_id is 26886 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba14003620 con 0x7fba4817fd00 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1886245875 0 0) 0x7fba4808a380 con 0x7fba4815e200 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.360 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): my global_id is 27245 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba481640c0 con 0x7fba4815e200 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 client.?.objecter ms_handle_connect 0x7fba48139f20 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3650607337 0 0) 0x7fba14003620 con 0x7fba4817fd00 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba4808a380 con 0x7fba4817fd00 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fba38003550 con 0x7fba4817fd00 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): dump: 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.361 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 62124269 0 0) 0x7fba481640c0 con 0x7fba4815e200 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba14003620 con 0x7fba4815e200 2026-02-13T08:07:58.362 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fba300034c0 con 0x7fba4815e200 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): dump: 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.363 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052466005 0 0) 0x7fba48162680 con 0x7fba48139f20 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient(hunting): my global_id is 74113 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba481640c0 con 0x7fba48139f20 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3541904560 0 0) 0x7fba4808a380 con 0x7fba4817fd00 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 >> v1:10.20.193.104:6790/0 conn(0x7fba4815e200 legacy=0x7fba4817e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 >> v1:10.20.193.119:6789/0 conn(0x7fba48139f20 legacy=0x7fba4817dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient: _finish_hunting 0 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 monclient: found mon.a 2026-02-13T08:07:58.364 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba4817edd0 con 0x7fba4817fd00 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient: _finish_auth 0 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient: _check_auth_tickets 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 5 monclient: authenticate success, global_id 26886 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: _renew_subs 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fba48162bd0 con 0x7fba4817fd00 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba380038c0 con 0x7fba4817fd00 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fba380050b0 con 0x7fba4817fd00 2026-02-13T08:07:58.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba44d72640 4 set_mon_vals no callback set 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba2effd640 10 monclient: dump: 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.366 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 client.26886.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: _renew_subs 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fba4817faf0 con 0x7fba4817fd00 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 librados: init done 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.332+0000 7fba4c8b2640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba48061860 con 0x7fba48163850 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 client.26886.objecter ms_handle_connect 0x7fba48163850 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 client.26886.objecter resend_mon_ops 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 227058107 0 0) 0x7fba48061860 con 0x7fba48163850 2026-02-13T08:07:58.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 monclient(hunting): my global_id is 27248 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba4808a380 con 0x7fba48163850 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fba38011140 con 0x7fba4817fd00 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(115..115 src has 1..115) ==== 5914+0+0 (unknown 2301697532 0 0) 0x7fba3804aef0 con 0x7fba4817fd00 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 client.26886.objecter ms_dispatch2 0x7fba48000ba0 osd_map(115..115 src has 1..115) 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 3 client.26886.objecter handle_osd_map got epochs [115,115] > 0 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 3 client.26886.objecter handle_osd_map decoding full epoch 115 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 20 client.26886.objecter dump_active .. 0 homeless 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3687249256 0 0) 0x7fba4808a380 con 0x7fba48163850 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba48061860 con 0x7fba48163850 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fba3c002e80 con 0x7fba48163850 2026-02-13T08:07:58.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 monclient: dump: 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4096213631 0 0) 0x7fba48061860 con 0x7fba48163850 2026-02-13T08:07:58.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fba48088e20 con 0x7fba48163850 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba45d74640 10 monclient: get_auth_request con 0x7fba1403ba10 auth_method 0 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 client.26886.objecter ms_handle_connect 0x7fba1403ba10 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7fba3c005210 con 0x7fba48163850 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 >> v1:10.20.193.104:6790/0 conn(0x7fba48163850 legacy=0x7fba4815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 >> v1:10.20.193.104:6790/0 conn(0x7fba48163850 legacy=0x7fba4815e5d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba4c8b2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.336+0000 7fba4c8b2640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fba4815f0b0 con 0x7fba4815ece0 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 10 client.26886.objecter ms_handle_connect 0x7fba4815ece0 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 10 client.26886.objecter resend_mon_ops 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 793895772 0 0) 0x7fba4815f0b0 con 0x7fba4815ece0 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 10 monclient(hunting): my global_id is 27251 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba48061860 con 0x7fba4815ece0 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1175651517 0 0) 0x7fba48061860 con 0x7fba4815ece0 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fba4815f0b0 con 0x7fba4815ece0 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fba3c003590 con 0x7fba4815ece0 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 10 monclient: dump: 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.371 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2874893316 0 0) 0x7fba4815f0b0 con 0x7fba4815ece0 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 --> v1:10.20.193.104:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fba4815f280 con 0x7fba4815ece0 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4492 (unknown 0 0 235263159) 0x7fba3c004ae0 con 0x7fba4815ece0 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 >> v1:10.20.193.104:6790/0 conn(0x7fba4815ece0 legacy=0x7fba481291d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba2effd640 1 -- 10.20.193.104:0/2266003056 >> v1:10.20.193.104:6790/0 conn(0x7fba4815ece0 legacy=0x7fba481291d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 22, 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 147747, 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.373 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:07:58.374 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:07:58.375 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:07:58.376 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:07:58.377 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:07:58.378 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:07:58.379 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.380 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.381 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: "num": 4 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.382 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.383 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:07:58.383 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 10 librados: watch_flush enter 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 10 librados: watch_flush exit 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 20 client.26886.objecter shutdown clearing up homeless session... 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 10 client.26886.objecter successfully canceled tick 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 1 -- 10.20.193.104:0/2266003056 >> v1:10.20.193.119:6812/276487904 conn(0x7fba1403ba10 legacy=0x7fba1405bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 10 monclient: shutdown 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba46d76640 1 -- 10.20.193.104:0/2266003056 reap_dead start 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 1 -- 10.20.193.104:0/2266003056 >> v1:10.20.193.104:6789/0 conn(0x7fba4817fd00 legacy=0x7fba48126aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 1 -- 10.20.193.104:0/2266003056 shutdown_connections 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 1 -- 10.20.193.104:0/2266003056 >> 10.20.193.104:0/2266003056 conn(0x7fba48051a50 msgr2=0x7fba4805bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:58.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 1 -- 10.20.193.104:0/2266003056 shutdown_connections 2026-02-13T08:07:58.385 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 1 -- 10.20.193.104:0/2266003056 wait complete. 2026-02-13T08:07:58.385 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.340+0000 7fba4c8b2640 1 librados: shutdown 2026-02-13T08:07:58.385 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:07:58.385 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T08:07:58.385 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T08:07:58.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: get_monmap_and_config 2026-02-13T08:07:58.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: build_initial_monmap 2026-02-13T08:07:58.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: monmap: 2026-02-13T08:07:58.452 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:58.452 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.452 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:07:58.448634+0000 2026-02-13T08:07:58.452 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:07:58.448634+0000 2026-02-13T08:07:58.452 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:58.453 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.453 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:58.453 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:07:58.453 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:07:58.453 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.459 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 Processor -- start 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- start start 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: init 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient(hunting): picked mon.noname-a con 0x7fb6340890c0 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient(hunting): picked mon.noname-c con 0x7fb63408a540 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient(hunting): picked mon.noname-b con 0x7fb63408a9a0 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb634086ef0 con 0x7fb6340890c0 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6340871d0 con 0x7fb63408a540 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6340874b0 con 0x7fb63408a9a0 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient(hunting): authenticate will time out at 584.037680s 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb6392ba640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fb6340890c0 0x7fb634089e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:43968/0 (socket says 10.20.193.104:43968) 2026-02-13T08:07:58.460 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb6392ba640 1 -- 10.20.193.104:0/3266656821 learned_addr learned my addr 10.20.193.104:0/3266656821 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 -- 10.20.193.104:0/3266656821 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4190612938 0 0) 0x7fb634086ef0 con 0x7fb6340890c0 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient(hunting): my global_id is 26889 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 -- 10.20.193.104:0/3266656821 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb61c003620 con 0x7fb6340890c0 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 -- 10.20.193.104:0/3266656821 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463436829 0 0) 0x7fb6340874b0 con 0x7fb63408a9a0 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient(hunting): my global_id is 27254 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 -- 10.20.193.104:0/3266656821 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb634086ef0 con 0x7fb63408a9a0 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 -- 10.20.193.104:0/3266656821 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1864943264 0 0) 0x7fb61c003620 con 0x7fb6340890c0 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 -- 10.20.193.104:0/3266656821 >> v1:10.20.193.104:6790/0 conn(0x7fb63408a9a0 legacy=0x7fb63419f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.461 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 -- 10.20.193.104:0/3266656821 >> v1:10.20.193.119:6789/0 conn(0x7fb63408a540 legacy=0x7fb63417e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient: _finish_hunting 0 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 monclient: found mon.noname-a 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 -- 10.20.193.104:0/3266656821 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb634086930 con 0x7fb6340890c0 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient: _finish_auth 0 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient: _check_auth_tickets 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 -- 10.20.193.104:0/3266656821 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb624002e00 con 0x7fb6340890c0 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient: dump: 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.462 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 5 monclient: authenticate success, global_id 26889 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 -- 10.20.193.104:0/3266656821 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb624003090 con 0x7fb6340890c0 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 1 -- 10.20.193.104:0/3266656821 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb6240034d0 con 0x7fb6340890c0 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb623fff640 10 monclient: dump: 2026-02-13T08:07:58.463 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: get_monmap_and_config success 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 4 set_mon_vals no callback set 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: shutdown 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- 10.20.193.104:0/3266656821 >> v1:10.20.193.104:6789/0 conn(0x7fb6340890c0 legacy=0x7fb634089e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- 10.20.193.104:0/3266656821 shutdown_connections 2026-02-13T08:07:58.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- 10.20.193.104:0/3266656821 >> 10.20.193.104:0/3266656821 conn(0x7fb634051a50 msgr2=0x7fb634051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- 10.20.193.104:0/3266656821 shutdown_connections 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- 10.20.193.104:0/3266656821 wait complete. 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: build_initial_monmap 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: monmap: 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 librados: starting msgr at 2026-02-13T08:07:58.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 librados: starting objecter 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 Processor -- start 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- start start 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 librados: setting wanted keys 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 librados: calling monclient init 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: init 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient(hunting): picked mon.noname-b con 0x7fb6340890c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient(hunting): picked mon.noname-c con 0x7fb63408a540 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient(hunting): picked mon.noname-a con 0x7fb63408a9a0 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63410b340 con 0x7fb63408a9a0 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb63410b620 con 0x7fb6340890c0 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb634109800 con 0x7fb63408a540 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb63b545640 10 monclient(hunting): authenticate will time out at 584.039899s 2026-02-13T08:07:58.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb638ab9640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fb63408a540 0x7fb63419cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57832/0 (socket says 10.20.193.104:57832) 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.444+0000 7fb638ab9640 1 -- 10.20.193.104:0/1524470076 learned_addr learned my addr 10.20.193.104:0/1524470076 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 client.?.objecter ms_handle_connect 0x7fb63408a540 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 client.?.objecter ms_handle_connect 0x7fb63408a9a0 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 client.?.objecter ms_handle_connect 0x7fb6340890c0 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3990651433 0 0) 0x7fb634109800 con 0x7fb63408a540 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): my global_id is 27257 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb604003620 con 0x7fb63408a540 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1853161101 0 0) 0x7fb63410b340 con 0x7fb63408a9a0 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): my global_id is 26892 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb634109800 con 0x7fb63408a9a0 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2259778290 0 0) 0x7fb63410b620 con 0x7fb6340890c0 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): my global_id is 74116 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb63410b340 con 0x7fb6340890c0 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2694676643 0 0) 0x7fb634109800 con 0x7fb63408a9a0 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb63410b620 con 0x7fb63408a9a0 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb6300033c0 con 0x7fb63408a9a0 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): dump: 2026-02-13T08:07:58.468 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3698727408 0 0) 0x7fb604003620 con 0x7fb63408a540 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb634109800 con 0x7fb63408a540 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb628004060 con 0x7fb63408a540 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:07:58.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): dump: 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2793593037 0 0) 0x7fb63410b620 con 0x7fb63408a9a0 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 >> v1:10.20.193.104:6790/0 conn(0x7fb63408a540 legacy=0x7fb63419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 >> v1:10.20.193.119:6789/0 conn(0x7fb6340890c0 legacy=0x7fb634133260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:07:58.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 monclient: found mon.a 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63405d570 con 0x7fb63408a9a0 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: _finish_auth 0 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb63b545640 5 monclient: authenticate success, global_id 26892 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb63b545640 10 monclient: _renew_subs 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb63b545640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb63b545640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb6340888b0 con 0x7fb63408a9a0 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb63b545640 10 client.26892.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb63b545640 10 monclient: _renew_subs 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb63b545640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb63b545640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb634108b40 con 0x7fb63408a9a0 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb63b545640 1 librados: init done 2026-02-13T08:07:58.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb630003a90 con 0x7fb63408a9a0 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb630003ea0 con 0x7fb63408a9a0 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: dump: 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.472 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb6237fe640 4 set_mon_vals no callback set 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb63b545640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb63b545640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb634061860 con 0x7fb634133970 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fb630004040 con 0x7fb63408a9a0 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 client.26892.objecter ms_handle_connect 0x7fb634133970 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 client.26892.objecter resend_mon_ops 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(115..115 src has 1..115) ==== 5914+0+0 (unknown 2301697532 0 0) 0x7fb630049c10 con 0x7fb63408a9a0 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 client.26892.objecter ms_dispatch2 0x7fb634000ba0 osd_map(115..115 src has 1..115) 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 3 client.26892.objecter handle_osd_map got epochs [115,115] > 0 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 3 client.26892.objecter handle_osd_map decoding full epoch 115 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 20 client.26892.objecter dump_active .. 0 homeless 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282864956 0 0) 0x7fb634061860 con 0x7fb634133970 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient(hunting): my global_id is 74119 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb63410b620 con 0x7fb634133970 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb638ab9640 10 monclient: get_auth_request con 0x7fb60403ba10 auth_method 0 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1170076484 0 0) 0x7fb63410b620 con 0x7fb634133970 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb634061860 con 0x7fb634133970 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb624002e80 con 0x7fb634133970 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: dump: 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.474 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.475 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.475 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 client.26892.objecter ms_handle_connect 0x7fb60403ba10 2026-02-13T08:07:58.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1991853936 0 0) 0x7fb634061860 con 0x7fb634133970 2026-02-13T08:07:58.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.119:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb634133d40 con 0x7fb634133970 2026-02-13T08:07:58.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7fb624002f80 con 0x7fb634133970 2026-02-13T08:07:58.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:07:58.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 >> v1:10.20.193.119:6789/0 conn(0x7fb634133970 legacy=0x7fb63405a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.448+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 >> v1:10.20.193.119:6789/0 conn(0x7fb634133970 legacy=0x7fb63405a170 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:07:58.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb63405af90 con 0x7fb634108e30 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 10 client.26892.objecter ms_handle_connect 0x7fb634108e30 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 10 client.26892.objecter resend_mon_ops 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2460491831 0 0) 0x7fb63405af90 con 0x7fb634108e30 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 10 monclient(hunting): my global_id is 74122 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb634061860 con 0x7fb634108e30 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2763288487 0 0) 0x7fb634061860 con 0x7fb634108e30 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb63405af90 con 0x7fb634108e30 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb624004be0 con 0x7fb634108e30 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 10 monclient: dump: 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3353610963 0 0) 0x7fb63405af90 con 0x7fb634108e30 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 --> v1:10.20.193.119:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb6341a2c60 con 0x7fb634108e30 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4157 (unknown 0 0 1158789448) 0x7fb624006010 con 0x7fb634108e30 2026-02-13T08:07:58.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:07:58.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:07:58.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 >> v1:10.20.193.119:6789/0 conn(0x7fb634108e30 legacy=0x7fb63405a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb621ffb640 1 -- 10.20.193.104:0/1524470076 >> v1:10.20.193.119:6789/0 conn(0x7fb634108e30 legacy=0x7fb63405a880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:07:58.479 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:07:58.479 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:07:58.479 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:07:58.479 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:07:58.479 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 22, 2026-02-13T08:07:58.479 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 15479, 2026-02-13T08:07:58.479 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:07:58.479 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:07:58.480 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:07:58.481 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:07:58.482 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:07:58.483 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:07:58.484 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:07:58.485 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:07:58.486 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: "num": 2 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:07:58.487 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 10 librados: watch_flush enter 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 10 librados: watch_flush exit 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 20 client.26892.objecter shutdown clearing up homeless session... 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 10 client.26892.objecter successfully canceled tick 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 1 -- 10.20.193.104:0/1524470076 >> v1:10.20.193.119:6812/276487904 conn(0x7fb60403ba10 legacy=0x7fb60405bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 10 monclient: shutdown 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 1 -- 10.20.193.104:0/1524470076 >> v1:10.20.193.104:6789/0 conn(0x7fb63408a9a0 legacy=0x7fb63419e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb639abb640 1 -- 10.20.193.104:0/1524470076 reap_dead start 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb639abb640 1 -- 10.20.193.104:0/1524470076 reap_dead start 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 1 -- 10.20.193.104:0/1524470076 shutdown_connections 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 1 -- 10.20.193.104:0/1524470076 >> 10.20.193.104:0/1524470076 conn(0x7fb634051a50 msgr2=0x7fb63408bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 1 -- 10.20.193.104:0/1524470076 shutdown_connections 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 1 -- 10.20.193.104:0/1524470076 wait complete. 2026-02-13T08:07:58.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.452+0000 7fb63b545640 1 librados: shutdown 2026-02-13T08:07:58.490 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:07:58.490 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T08:07:58.490 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T08:07:58.559 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.548+0000 7ff9c34c3640 10 monclient: get_monmap_and_config 2026-02-13T08:07:58.559 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.548+0000 7ff9c34c3640 10 monclient: build_initial_monmap 2026-02-13T08:07:58.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.548+0000 7ff9c34c3640 10 monclient: monmap: 2026-02-13T08:07:58.560 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:58.560 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.560 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:07:58.555949+0000 2026-02-13T08:07:58.560 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:07:58.555949+0000 2026-02-13T08:07:58.560 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:58.560 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.560 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:58.560 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:07:58.560 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:07:58.560 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.568 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 Processor -- start 2026-02-13T08:07:58.568 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- start start 2026-02-13T08:07:58.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient: init 2026-02-13T08:07:58.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:58.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:07:58.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient(hunting): picked mon.noname-c con 0x7ff9bc08e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:58.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient(hunting): picked mon.noname-b con 0x7ff9bc08ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:58.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient(hunting): picked mon.noname-a con 0x7ff9bc17fe50 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:58.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9bc089fa0 con 0x7ff9bc17fe50 2026-02-13T08:07:58.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9bc089760 con 0x7ff9bc08e4b0 2026-02-13T08:07:58.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9bc08af90 con 0x7ff9bc08ef90 2026-02-13T08:07:58.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:58.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient(hunting): authenticate will time out at 584.145026s 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c0a37640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7ff9bc08ef90 0x7ff9bc17e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57844/0 (socket says 10.20.193.104:57844) 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c0a37640 1 -- 10.20.193.104:0/3690306176 learned_addr learned my addr 10.20.193.104:0/3690306176 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 -- 10.20.193.104:0/3690306176 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755846286 0 0) 0x7ff9bc08af90 con 0x7ff9bc08ef90 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient(hunting): my global_id is 27260 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 -- 10.20.193.104:0/3690306176 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9a4003620 con 0x7ff9bc08ef90 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 -- 10.20.193.104:0/3690306176 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537476593 0 0) 0x7ff9bc089fa0 con 0x7ff9bc17fe50 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient(hunting): my global_id is 26895 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 -- 10.20.193.104:0/3690306176 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9bc08af90 con 0x7ff9bc17fe50 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 -- 10.20.193.104:0/3690306176 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2717238523 0 0) 0x7ff9a4003620 con 0x7ff9bc08ef90 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 -- 10.20.193.104:0/3690306176 >> v1:10.20.193.119:6789/0 conn(0x7ff9bc08e4b0 legacy=0x7ff9bc08e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 -- 10.20.193.104:0/3690306176 >> v1:10.20.193.104:6789/0 conn(0x7ff9bc17fe50 legacy=0x7ff9bc1a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient: _finish_hunting 0 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 monclient: found mon.noname-b 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 -- 10.20.193.104:0/3690306176 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9bc08b270 con 0x7ff9bc08ef90 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient: _finish_auth 0 2026-02-13T08:07:58.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient: _check_auth_tickets 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 -- 10.20.193.104:0/3690306176 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7ff9b0002e00 con 0x7ff9bc08ef90 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient: dump: 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.572 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 5 monclient: authenticate success, global_id 27260 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 -- 10.20.193.104:0/3690306176 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9b00030c0 con 0x7ff9bc08ef90 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 1 -- 10.20.193.104:0/3690306176 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7ff9b0003500 con 0x7ff9bc08ef90 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9abfff640 10 monclient: dump: 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.573 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient: get_monmap_and_config success 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 4 set_mon_vals no callback set 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient: shutdown 2026-02-13T08:07:58.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- 10.20.193.104:0/3690306176 >> v1:10.20.193.104:6790/0 conn(0x7ff9bc08ef90 legacy=0x7ff9bc17e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- 10.20.193.104:0/3690306176 shutdown_connections 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- 10.20.193.104:0/3690306176 >> 10.20.193.104:0/3690306176 conn(0x7ff9bc051e80 msgr2=0x7ff9bc08c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- 10.20.193.104:0/3690306176 shutdown_connections 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- 10.20.193.104:0/3690306176 wait complete. 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient: build_initial_monmap 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient: monmap: 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:58.575 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 librados: starting msgr at 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 librados: starting objecter 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 Processor -- start 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- start start 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 librados: setting wanted keys 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 librados: calling monclient init 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient: init 2026-02-13T08:07:58.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient(hunting): picked mon.noname-b con 0x7ff9bc08e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient(hunting): picked mon.noname-c con 0x7ff9bc08ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient(hunting): picked mon.noname-a con 0x7ff9bc17fe50 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9bc088590 con 0x7ff9bc17fe50 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9bc12b750 con 0x7ff9bc08e4b0 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9bc059f50 con 0x7ff9bc08ef90 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c34c3640 10 monclient(hunting): authenticate will time out at 584.147508s 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c0a37640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7ff9bc08ef90 0x7ff9bc12b040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57852/0 (socket says 10.20.193.104:57852) 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9c0a37640 1 -- 10.20.193.104:0/2297718215 learned_addr learned my addr 10.20.193.104:0/2297718215 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:58.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 client.?.objecter ms_handle_connect 0x7ff9bc08ef90 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 client.?.objecter ms_handle_connect 0x7ff9bc17fe50 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545027232 0 0) 0x7ff9bc059f50 con 0x7ff9bc08ef90 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): my global_id is 27263 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff98c003620 con 0x7ff9bc08ef90 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074185025 0 0) 0x7ff9bc088590 con 0x7ff9bc17fe50 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): my global_id is 26898 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9bc059f50 con 0x7ff9bc17fe50 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 client.?.objecter ms_handle_connect 0x7ff9bc08e4b0 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3974232219 0 0) 0x7ff98c003620 con 0x7ff9bc08ef90 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9bc088590 con 0x7ff9bc08ef90 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7ff9b0002dc0 con 0x7ff9bc08ef90 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): dump: 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.579 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2698327824 0 0) 0x7ff9bc12b750 con 0x7ff9bc08e4b0 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:58.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): my global_id is 74128 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff98c003620 con 0x7ff9bc08e4b0 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2576379938 0 0) 0x7ff9bc059f50 con 0x7ff9bc17fe50 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9bc12b750 con 0x7ff9bc17fe50 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7ff9b80032e0 con 0x7ff9bc17fe50 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.552+0000 7ff9a9ffb640 10 monclient(hunting): dump: 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.581 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3726430646 0 0) 0x7ff9bc088590 con 0x7ff9bc08ef90 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 >> v1:10.20.193.119:6789/0 conn(0x7ff9bc08e4b0 legacy=0x7ff9bc12a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 >> v1:10.20.193.104:6789/0 conn(0x7ff9bc17fe50 legacy=0x7ff9bc170220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 1 monclient: found mon.c 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:58.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9bc086790 con 0x7ff9bc08ef90 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 monclient: _finish_auth 0 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 5 monclient: authenticate success, global_id 27263 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 10 monclient: _renew_subs 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 1 -- 10.20.193.104:0/2297718215 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff9bc080890 con 0x7ff9bc08ef90 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 10 client.27263.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 10 monclient: _renew_subs 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:07:58.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 1 -- 10.20.193.104:0/2297718215 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff9bc07f090 con 0x7ff9bc08ef90 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 1 librados: init done 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9b0004cf0 con 0x7ff9bc08ef90 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7ff9b0005040 con 0x7ff9bc08ef90 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 monclient: dump: 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:58.584 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9ab7fe640 4 set_mon_vals no callback set 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7ff9b0011050 con 0x7ff9bc08ef90 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c34c3640 1 -- 10.20.193.104:0/2297718215 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9bc0380f0 con 0x7ff9bc08ef90 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(115..115 src has 1..115) ==== 5914+0+0 (unknown 2301697532 0 0) 0x7ff9b004ab10 con 0x7ff9bc08ef90 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 client.27263.objecter ms_dispatch2 0x7ff9bc000ba0 osd_map(115..115 src has 1..115) 2026-02-13T08:07:58.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 3 client.27263.objecter handle_osd_map got epochs [115,115] > 0 2026-02-13T08:07:58.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 3 client.27263.objecter handle_osd_map decoding full epoch 115 2026-02-13T08:07:58.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 20 client.27263.objecter dump_active .. 0 homeless 2026-02-13T08:07:58.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9c1238640 10 monclient: get_auth_request con 0x7ff98c03bad0 auth_method 0 2026-02-13T08:07:58.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 client.27263.objecter ms_handle_connect 0x7ff98c03bad0 2026-02-13T08:07:58.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7ff9b0016c80 con 0x7ff9bc08ef90 2026-02-13T08:07:58.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:58.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.556+0000 7ff9a9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:07:58.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T08:07:58.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T08:07:58.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:07:58.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 1 -- 10.20.193.104:0/2297718215 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7ff9bc080600 con 0x7ff9bc08ef90 2026-02-13T08:07:58.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9a9ffb640 1 -- 10.20.193.104:0/2297718215 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7ff9b0016580 con 0x7ff9bc08ef90 2026-02-13T08:07:58.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9a9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T08:07:58.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9a9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:07:58.686 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.686 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=13,kv=9,logm=64} crc {auth=2995148853,config=3140514009,health=1796179531,kv=2253358130,logm=2428962612}) 2026-02-13T08:07:58.686 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=14,config=2,health=13,kv=10,logm=61} crc {auth=319034732,config=3140514009,health=3598802689,kv=1692168360,logm=2310928050}) 2026-02-13T08:07:58.686 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.686 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=13,kv=9,logm=64} crc {auth=2995148853,config=3140514009,health=1796179531,kv=2253358130,logm=2428962612}) 2026-02-13T08:07:58.686 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=11,config=2,health=12,kv=9,logm=66} crc {auth=848428933,config=3140514009,health=3897446751,kv=2426215588,logm=2646958014}) 2026-02-13T08:07:58.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 10 librados: watch_flush enter 2026-02-13T08:07:58.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 10 librados: watch_flush exit 2026-02-13T08:07:58.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 20 client.27263.objecter shutdown clearing up homeless session... 2026-02-13T08:07:58.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 10 client.27263.objecter successfully canceled tick 2026-02-13T08:07:58.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 1 -- 10.20.193.104:0/2297718215 >> v1:10.20.193.119:6812/276487904 conn(0x7ff98c03bad0 legacy=0x7ff98c05bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 10 monclient: shutdown 2026-02-13T08:07:58.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:58.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 1 -- 10.20.193.104:0/2297718215 >> v1:10.20.193.104:6790/0 conn(0x7ff9bc08ef90 legacy=0x7ff9bc12b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:58.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 1 -- 10.20.193.104:0/2297718215 shutdown_connections 2026-02-13T08:07:58.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 1 -- 10.20.193.104:0/2297718215 >> 10.20.193.104:0/2297718215 conn(0x7ff9bc051e80 msgr2=0x7ff9bc05cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:58.688 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.689 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=495372260}) 2026-02-13T08:07:58.689 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3219460980}) 2026-02-13T08:07:58.689 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 1 -- 10.20.193.104:0/2297718215 shutdown_connections 2026-02-13T08:07:58.689 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=495372260}) 2026-02-13T08:07:58.690 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3493194353}) 2026-02-13T08:07:58.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 1 -- 10.20.193.104:0/2297718215 wait complete. 2026-02-13T08:07:58.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:58.676+0000 7ff9c34c3640 1 librados: shutdown 2026-02-13T08:07:58.695 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.695 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2972250511}) 2026-02-13T08:07:58.695 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1573920799}) 2026-02-13T08:07:58.695 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2972250511}) 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3749895964}) 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2011075386}) 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1248228164}) 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2011075386}) 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1811579991}) 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238978252}) 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=561413030}) 2026-02-13T08:07:58.696 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238978252}) 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.676+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3367328083}) 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3481251973}) 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3311136987}) 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3481251973}) 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=762424991}) 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1477875485}) 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=701573516}) 2026-02-13T08:07:58.697 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1477875485}) 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1275169405}) 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3315715781}) 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3915462244}) 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3315715781}) 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=92049793}) 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3452888180}) 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2339854986}) 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.698 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3452888180}) 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3020664238}) 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2197551346}) 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1084232531}) 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2197551346}) 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1397192578}) 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=801698394}) 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2141931966}) 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=801698394}) 2026-02-13T08:07:58.699 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4120346703}) 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3333629268}) 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2324941295}) 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3333629268}) 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.680+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2384661319}) 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75007489}) 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3198124402}) 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75007489}) 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=442470829}) 2026-02-13T08:07:58.700 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.701 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210878781}) 2026-02-13T08:07:58.701 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=844934677}) 2026-02-13T08:07:58.701 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.701 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210878781}) 2026-02-13T08:07:58.701 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2975527408}) 2026-02-13T08:07:58.701 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.701 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=84,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=3} crc {logm=3251854066,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=1559368745}) 2026-02-13T08:07:58.701 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=86,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=2} crc {logm=2030780505,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgrstat=1797969957}) 2026-02-13T08:07:58.701 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.701 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=84,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=3} crc {logm=3251854066,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=1559368745}) 2026-02-13T08:07:58.701 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=84,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=4} crc {logm=1111126810,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgrstat=3608303098}) 2026-02-13T08:07:58.702 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.702 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=11,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=53} crc {mgrstat=3336250960,mon_config_key=1358190956,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=2315316943,osd_pg_creating=1862603895,osd_snap=3532636285,osdmap=1906305924}) 2026-02-13T08:07:58.702 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgrstat=11,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=54} crc {mgrstat=3336250960,mon_config_key=979376481,monmap=2430536721,nvmeofgw=3360707892,osd_metadata=2315316943,osd_pg_creating=1862603895,osd_snap=874099328,osdmap=4087293626}) 2026-02-13T08:07:58.702 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.702 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgrstat=11,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=53} crc {mgrstat=3336250960,mon_config_key=1358190956,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=2315316943,osd_pg_creating=1862603895,osd_snap=3532636285,osdmap=1906305924}) 2026-02-13T08:07:58.702 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgrstat=11,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=54} crc {mgrstat=3336250960,mon_config_key=4286042592,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=2315316944,osd_pg_creating=1862603895,osd_snap=2232365956,osdmap=3316084550}) 2026-02-13T08:07:58.703 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T08:07:58.704 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.704 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4055123735}) 2026-02-13T08:07:58.704 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=555201819}) 2026-02-13T08:07:58.704 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.704 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4055123735}) 2026-02-13T08:07:58.704 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3774227260}) 2026-02-13T08:07:58.704 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.705 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=32} crc {osdmap=28746335}) 2026-02-13T08:07:58.705 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=30} crc {osdmap=3010698123}) 2026-02-13T08:07:58.705 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:07:58.705 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=32} crc {osdmap=28746335}) 2026-02-13T08:07:58.705 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:07:58.684+0000 7f688ef76640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=30} crc {osdmap=909906587}) 2026-02-13T08:07:59.704 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T08:07:59.704 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:07:59.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient: get_monmap_and_config 2026-02-13T08:07:59.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient: build_initial_monmap 2026-02-13T08:07:59.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient: monmap: 2026-02-13T08:07:59.774 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:59.774 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:59.774 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:07:59.770193+0000 2026-02-13T08:07:59.774 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:07:59.770193+0000 2026-02-13T08:07:59.774 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:59.774 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.774 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:59.775 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:07:59.775 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:07:59.775 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 1 Processor -- start 2026-02-13T08:07:59.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 1 -- start start 2026-02-13T08:07:59.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient: init 2026-02-13T08:07:59.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:59.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient(hunting): picked mon.noname-a con 0x7f67a008e4b0 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient(hunting): picked mon.noname-c con 0x7f67a008ef90 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient(hunting): picked mon.noname-b con 0x7f67a017fe50 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a0089fa0 con 0x7f67a008e4b0 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a0089760 con 0x7f67a008ef90 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a008af90 con 0x7f67a017fe50 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient(hunting): authenticate will time out at 585.359229s 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679f7fe640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f67a017fe50 0x7f67a01a0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57858/0 (socket says 10.20.193.104:57858) 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679f7fe640 1 -- 10.20.193.104:0/2157673574 learned_addr learned my addr 10.20.193.104:0/2157673574 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 -- 10.20.193.104:0/2157673574 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649438384 0 0) 0x7f67a008af90 con 0x7f67a017fe50 2026-02-13T08:07:59.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient(hunting): my global_id is 27272 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 -- 10.20.193.104:0/2157673574 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f678c003620 con 0x7f67a017fe50 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 -- 10.20.193.104:0/2157673574 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155649377 0 0) 0x7f67a0089fa0 con 0x7f67a008e4b0 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient(hunting): my global_id is 26907 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 -- 10.20.193.104:0/2157673574 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67a008af90 con 0x7f67a008e4b0 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 -- 10.20.193.104:0/2157673574 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3208811188 0 0) 0x7f678c003620 con 0x7f67a017fe50 2026-02-13T08:07:59.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 -- 10.20.193.104:0/2157673574 >> v1:10.20.193.119:6789/0 conn(0x7f67a008ef90 legacy=0x7f67a017e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 -- 10.20.193.104:0/2157673574 >> v1:10.20.193.104:6789/0 conn(0x7f67a008e4b0 legacy=0x7f67a008e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient: _finish_hunting 0 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 monclient: found mon.noname-b 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 -- 10.20.193.104:0/2157673574 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a008b270 con 0x7f67a017fe50 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient: _finish_auth 0 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient: _check_auth_tickets 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 -- 10.20.193.104:0/2157673574 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6790003180 con 0x7f67a017fe50 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:07:59.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient: dump: 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 5 monclient: authenticate success, global_id 27272 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:07:59.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 -- 10.20.193.104:0/2157673574 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6790003390 con 0x7f67a017fe50 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 1 -- 10.20.193.104:0/2157673574 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f67900037d0 con 0x7f67a017fe50 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f679dffb640 10 monclient: dump: 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:59.787 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 10 monclient: get_monmap_and_config success 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.764+0000 7f67a5585640 4 set_mon_vals no callback set 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: shutdown 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- 10.20.193.104:0/2157673574 >> v1:10.20.193.104:6790/0 conn(0x7f67a017fe50 legacy=0x7f67a01a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- 10.20.193.104:0/2157673574 shutdown_connections 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- 10.20.193.104:0/2157673574 >> 10.20.193.104:0/2157673574 conn(0x7f67a0051e80 msgr2=0x7f67a008c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- 10.20.193.104:0/2157673574 shutdown_connections 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- 10.20.193.104:0/2157673574 wait complete. 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: build_initial_monmap 2026-02-13T08:07:59.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: monmap: 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 librados: starting msgr at 2026-02-13T08:07:59.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 librados: starting objecter 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 Processor -- start 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- start start 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 librados: setting wanted keys 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 librados: calling monclient init 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: init 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient(hunting): picked mon.noname-c con 0x7f67a008e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient(hunting): picked mon.noname-a con 0x7f67a008ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient(hunting): picked mon.noname-b con 0x7f67a017fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a007f6f0 con 0x7f67a008ef90 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a00884a0 con 0x7f67a017fe50 2026-02-13T08:07:59.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67a007fdc0 con 0x7f67a008e4b0 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient(hunting): authenticate will time out at 585.361107s 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f679effd640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f67a008e4b0 0x7f67a0084bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57864/0 (socket says 10.20.193.104:57864) 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f679effd640 1 -- 10.20.193.104:0/1064087508 learned_addr learned my addr 10.20.193.104:0/1064087508 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f679e7fc640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f67a008ef90 0x7f67a012de20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44000/0 (socket says 10.20.193.104:44000) 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 client.?.objecter ms_handle_connect 0x7f67a008ef90 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 client.?.objecter ms_handle_connect 0x7f67a008e4b0 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654497768 0 0) 0x7f67a007f6f0 con 0x7f67a008ef90 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:59.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): my global_id is 26910 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f676c003620 con 0x7f67a008ef90 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 client.?.objecter ms_handle_connect 0x7f67a017fe50 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88155526 0 0) 0x7f67a007fdc0 con 0x7f67a008e4b0 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): my global_id is 27275 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67a007f6f0 con 0x7f67a008e4b0 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2416434724 0 0) 0x7f676c003620 con 0x7f67a008ef90 2026-02-13T08:07:59.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67a007fdc0 con 0x7f67a008ef90 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f67880030a0 con 0x7f67a008ef90 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): dump: 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:59.793 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 963478166 0 0) 0x7f67a00884a0 con 0x7f67a017fe50 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): my global_id is 74140 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f676c003620 con 0x7f67a017fe50 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4103816554 0 0) 0x7f67a007f6f0 con 0x7f67a008e4b0 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67a00884a0 con 0x7f67a008e4b0 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6794003100 con 0x7f67a008e4b0 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:59.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient(hunting): dump: 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 151164655 0 0) 0x7f67a007fdc0 con 0x7f67a008ef90 2026-02-13T08:07:59.795 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 >> v1:10.20.193.104:6790/0 conn(0x7f67a008e4b0 legacy=0x7f67a0084bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 >> v1:10.20.193.119:6789/0 conn(0x7f67a017fe50 legacy=0x7f67a0170190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 monclient: found mon.a 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a00800a0 con 0x7f67a008ef90 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient: _finish_auth 0 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 5 monclient: authenticate success, global_id 26910 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: _renew_subs 2026-02-13T08:07:59.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- 10.20.193.104:0/1064087508 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f67a00852d0 con 0x7f67a008ef90 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 client.26910.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: _renew_subs 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- 10.20.193.104:0/1064087508 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f67a012e810 con 0x7f67a008ef90 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 librados: init done 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6788003710 con 0x7f67a008ef90 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6788003b20 con 0x7f67a008ef90 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 monclient: dump: 2026-02-13T08:07:59.797 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f679d7fa640 4 set_mon_vals no callback set 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:59.798 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f67a5585640 1 -- 10.20.193.104:0/1064087508 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a0061860 con 0x7f67a008ef90 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f6788003cc0 con 0x7f67a008ef90 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(116..116 src has 1..116) ==== 5123+0+0 (unknown 4114933034 0 0) 0x7f678804a710 con 0x7f67a008ef90 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 client.26910.objecter ms_dispatch2 0x7f67a0000ba0 osd_map(116..116 src has 1..116) 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 3 client.26910.objecter handle_osd_map got epochs [116,116] > 0 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 3 client.26910.objecter handle_osd_map decoding full epoch 116 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 20 client.26910.objecter dump_active .. 0 homeless 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f679effd640 10 monclient: get_auth_request con 0x7f676c03b9f0 auth_method 0 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.768+0000 7f677f7fe640 10 client.26910.objecter ms_handle_connect 0x7f676c03b9f0 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.772+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f6788016ad0 con 0x7f67a008ef90 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.772+0000 7f677f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:07:59.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.772+0000 7f677f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:07:59.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:07:59.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:07:59.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:07:59.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 1 -- 10.20.193.104:0/1064087508 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f67a008cc70 con 0x7f67a008ef90 2026-02-13T08:07:59.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f677f7fe640 1 -- 10.20.193.104:0/1064087508 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1475 (unknown 254746657 0 1870986912) 0x7f678801bab0 con 0x7f67a008ef90 2026-02-13T08:07:59.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f677f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:07:59.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f677f7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:07:59.898 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":22,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:07:59.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 10 librados: watch_flush enter 2026-02-13T08:07:59.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 10 librados: watch_flush exit 2026-02-13T08:07:59.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 20 client.26910.objecter shutdown clearing up homeless session... 2026-02-13T08:07:59.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 10 client.26910.objecter successfully canceled tick 2026-02-13T08:07:59.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 1 -- 10.20.193.104:0/1064087508 >> v1:10.20.193.119:6812/276487904 conn(0x7f676c03b9f0 legacy=0x7f676c05bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 10 monclient: shutdown 2026-02-13T08:07:59.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:59.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 1 -- 10.20.193.104:0/1064087508 >> v1:10.20.193.104:6789/0 conn(0x7f67a008ef90 legacy=0x7f67a012de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 1 -- 10.20.193.104:0/1064087508 shutdown_connections 2026-02-13T08:07:59.900 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 1 -- 10.20.193.104:0/1064087508 >> 10.20.193.104:0/1064087508 conn(0x7f67a0051e80 msgr2=0x7f67a005b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:59.900 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 1 -- 10.20.193.104:0/1064087508 shutdown_connections 2026-02-13T08:07:59.900 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 1 -- 10.20.193.104:0/1064087508 wait complete. 2026-02-13T08:07:59.900 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.888+0000 7f67a5585640 1 librados: shutdown 2026-02-13T08:07:59.907 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T08:07:59.907 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T08:07:59.907 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T08:07:59.907 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T08:07:59.975 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.964+0000 7f65e84d1640 10 monclient: get_monmap_and_config 2026-02-13T08:07:59.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.964+0000 7f65e84d1640 10 monclient: build_initial_monmap 2026-02-13T08:07:59.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.964+0000 7f65e84d1640 10 monclient: monmap: 2026-02-13T08:07:59.976 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:59.976 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:59.976 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:07:59.971872+0000 2026-02-13T08:07:59.976 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:07:59.971872+0000 2026-02-13T08:07:59.976 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:59.976 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.976 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:59.976 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:07:59.976 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:07:59.977 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 Processor -- start 2026-02-13T08:07:59.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- start start 2026-02-13T08:07:59.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: init 2026-02-13T08:07:59.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient(hunting): picked mon.noname-a con 0x7f65e0139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient(hunting): picked mon.noname-c con 0x7f65e015e200 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient(hunting): picked mon.noname-b con 0x7f65e017fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e013aa00 con 0x7f65e0139f20 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e008ba20 con 0x7f65e015e200 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e0089e30 con 0x7f65e017fd00 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient(hunting): authenticate will time out at 585.560588s 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e6246640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f65e0139f20 0x7f65e013a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44004/0 (socket says 10.20.193.104:44004) 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e6246640 1 -- 10.20.193.104:0/1324023805 learned_addr learned my addr 10.20.193.104:0/1324023805 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:59.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 -- 10.20.193.104:0/1324023805 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4045548199 0 0) 0x7f65d0002920 con 0x7f65e0139f20 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient(hunting): _negotiate 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient(hunting): my global_id is 26913 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 -- 10.20.193.104:0/1324023805 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65c8003620 con 0x7f65e0139f20 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 -- 10.20.193.104:0/1324023805 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 550052997 0 0) 0x7f65e0089e30 con 0x7f65e017fd00 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient(hunting): _negotiate 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient(hunting): my global_id is 27278 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 -- 10.20.193.104:0/1324023805 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65d0002920 con 0x7f65e017fd00 2026-02-13T08:07:59.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 -- 10.20.193.104:0/1324023805 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1143767128 0 0) 0x7f65d0002920 con 0x7f65e017fd00 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 -- 10.20.193.104:0/1324023805 >> v1:10.20.193.119:6789/0 conn(0x7f65e015e200 legacy=0x7f65e017e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 -- 10.20.193.104:0/1324023805 >> v1:10.20.193.104:6789/0 conn(0x7f65e0139f20 legacy=0x7f65e013a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient: _finish_hunting 0 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 monclient: found mon.noname-b 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 -- 10.20.193.104:0/1324023805 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e008a380 con 0x7f65e017fd00 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient: _finish_auth 0 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient: _check_auth_tickets 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 -- 10.20.193.104:0/1324023805 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f65dc003100 con 0x7f65e017fd00 2026-02-13T08:07:59.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient: dump: 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.989 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 5 monclient: authenticate success, global_id 27278 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 -- 10.20.193.104:0/1324023805 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65dc003310 con 0x7f65e017fd00 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient: handle_config config(0 keys) 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 1 -- 10.20.193.104:0/1324023805 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f65dc003750 con 0x7f65e017fd00 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e5244640 10 monclient: dump: 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:59.990 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: get_monmap_and_config success 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 4 set_mon_vals no callback set 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: shutdown 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- 10.20.193.104:0/1324023805 >> v1:10.20.193.104:6790/0 conn(0x7f65e017fd00 legacy=0x7f65e01a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- 10.20.193.104:0/1324023805 shutdown_connections 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- 10.20.193.104:0/1324023805 >> 10.20.193.104:0/1324023805 conn(0x7f65e0051a50 msgr2=0x7f65e0051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:07:59.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- 10.20.193.104:0/1324023805 shutdown_connections 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- 10.20.193.104:0/1324023805 wait complete. 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: build_initial_monmap 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: monmap: 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:07:59.992 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 librados: starting msgr at 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 librados: starting objecter 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 Processor -- start 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- start start 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 librados: setting wanted keys 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 librados: calling monclient init 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: init 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: _reopen_session rank -1 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient(hunting): picked mon.noname-a con 0x7f65e0139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient(hunting): picked mon.noname-c con 0x7f65e015e200 addr v1:10.20.193.104:6790/0 2026-02-13T08:07:59.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient(hunting): picked mon.noname-b con 0x7f65e017fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e0188680 con 0x7f65e0139f20 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e0188960 con 0x7f65e017fd00 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e005d570 con 0x7f65e015e200 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient(hunting): _renew_subs 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient(hunting): authenticate will time out at 585.562921s 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e6246640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f65e0139f20 0x7f65e0086bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44014/0 (socket says 10.20.193.104:44014) 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e6246640 1 -- 10.20.193.104:0/3004452726 learned_addr learned my addr 10.20.193.104:0/3004452726 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 client.?.objecter ms_handle_connect 0x7f65e0139f20 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 client.?.objecter ms_handle_connect 0x7f65e015e200 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:59.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063451819 0 0) 0x7f65e0188680 con 0x7f65e0139f20 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): my global_id is 26916 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65b0003620 con 0x7f65e0139f20 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3569066510 0 0) 0x7f65e005d570 con 0x7f65e015e200 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): my global_id is 27281 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e0188680 con 0x7f65e015e200 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1832002761 0 0) 0x7f65e0188680 con 0x7f65e015e200 2026-02-13T08:07:59.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65e005d570 con 0x7f65e015e200 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f65d4003070 con 0x7f65e015e200 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): dump: 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:59.996 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 client.?.objecter ms_handle_connect 0x7f65e017fd00 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4140091440 0 0) 0x7f65b0003620 con 0x7f65e0139f20 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65e0188680 con 0x7f65e0139f20 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f65d0003210 con 0x7f65e0139f20 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient(hunting): dump: 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:07:59.997 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2529902942 0 0) 0x7f65e005d570 con 0x7f65e015e200 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 >> v1:10.20.193.119:6789/0 conn(0x7f65e017fd00 legacy=0x7f65e0127ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 >> v1:10.20.193.104:6789/0 conn(0x7f65e0139f20 legacy=0x7f65e0086bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 monclient: found mon.c 2026-02-13T08:07:59.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e0086620 con 0x7f65e015e200 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient: _finish_auth 0 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 5 monclient: authenticate success, global_id 27281 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: _renew_subs 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f65e01883a0 con 0x7f65e015e200 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 client.27281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: _renew_subs 2026-02-13T08:07:59.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f65e00879e0 con 0x7f65e015e200 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 librados: init done 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65d4003710 con 0x7f65e015e200 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f65d4003aa0 con 0x7f65e015e200 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 10 monclient: dump: 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.000 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e4a43640 4 set_mon_vals no callback set 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65e84d1640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f65e0061860 con 0x7f65e005ae20 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.968+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f65d4003cc0 con 0x7f65e015e200 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 client.27281.objecter ms_handle_connect 0x7f65e005ae20 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 client.27281.objecter resend_mon_ops 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(116..116 src has 1..116) ==== 5123+0+0 (unknown 4114933034 0 0) 0x7f65d4049670 con 0x7f65e015e200 2026-02-13T08:08:00.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 client.27281.objecter ms_dispatch2 0x7f65e0000ba0 osd_map(116..116 src has 1..116) 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 3 client.27281.objecter handle_osd_map got epochs [116,116] > 0 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 3 client.27281.objecter handle_osd_map decoding full epoch 116 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 20 client.27281.objecter dump_active .. 0 homeless 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2336040356 0 0) 0x7f65e0061860 con 0x7f65e005ae20 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 monclient(hunting): my global_id is 26919 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e005d570 con 0x7f65e005ae20 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3492303007 0 0) 0x7f65e005d570 con 0x7f65e005ae20 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65e6a47640 10 monclient: get_auth_request con 0x7f65b003b890 auth_method 0 2026-02-13T08:08:00.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65e0061860 con 0x7f65e005ae20 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f65d0004a80 con 0x7f65e005ae20 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 monclient: dump: 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.003 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3052187817 0 0) 0x7f65e0061860 con 0x7f65e005ae20 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65e0058eb0 con 0x7f65e005ae20 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 client.27281.objecter ms_handle_connect 0x7f65b003b890 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f65d0004a70 con 0x7f65e005ae20 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 >> v1:10.20.193.104:6789/0 conn(0x7f65e005ae20 legacy=0x7f65e005b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 >> v1:10.20.193.104:6789/0 conn(0x7f65e005ae20 legacy=0x7f65e005b1f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65e84d1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.972+0000 7f65e84d1640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f65e005bd00 con 0x7f65e005b900 2026-02-13T08:08:00.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 10 client.27281.objecter ms_handle_connect 0x7f65e005b900 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 10 client.27281.objecter resend_mon_ops 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1057353028 0 0) 0x7f65e005bd00 con 0x7f65e005b900 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 10 monclient(hunting): my global_id is 26922 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65e0061860 con 0x7f65e005b900 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2960988322 0 0) 0x7f65e0061860 con 0x7f65e005b900 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65e005bd00 con 0x7f65e005b900 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f65d00051c0 con 0x7f65e005b900 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:08:00.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 10 monclient: dump: 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 319413103 0 0) 0x7f65e005bd00 con 0x7f65e005b900 2026-02-13T08:08:00.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 --> v1:10.20.193.104:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f65e0088e20 con 0x7f65e005b900 2026-02-13T08:08:00.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4327 (unknown 0 0 3872599629) 0x7f65d00074c0 con 0x7f65e005b900 2026-02-13T08:08:00.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:08:00.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:08:00.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 >> v1:10.20.193.104:6789/0 conn(0x7f65e005b900 legacy=0x7f65e012a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65c6ffd640 1 -- 10.20.193.104:0/3004452726 >> v1:10.20.193.104:6789/0 conn(0x7f65e005b900 legacy=0x7f65e012a1e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:08:00.007 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:08:00.007 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:08:00.007 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 22, 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 149387, 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 1, 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:08:00.008 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:00.009 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:00.010 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:08:00.011 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:00.012 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:00.013 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:00.014 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:08:00.015 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.016 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: "num": 2 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.017 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:08:00.018 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.018 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:00.018 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:00.018 INFO:teuthology.orchestra.run.trial104.stdout: "num": 3 2026-02-13T08:08:00.018 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.018 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.018 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.018 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:08:00.018 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:08:00.019 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 10 librados: watch_flush enter 2026-02-13T08:08:00.019 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 10 librados: watch_flush exit 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 20 client.27281.objecter shutdown clearing up homeless session... 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 10 client.27281.objecter successfully canceled tick 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 1 -- 10.20.193.104:0/3004452726 >> v1:10.20.193.119:6812/276487904 conn(0x7f65b003b890 legacy=0x7f65b005bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 10 monclient: shutdown 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 1 -- 10.20.193.104:0/3004452726 >> v1:10.20.193.104:6790/0 conn(0x7f65e015e200 legacy=0x7f65e00872d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e6a47640 1 -- 10.20.193.104:0/3004452726 reap_dead start 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e6a47640 1 -- 10.20.193.104:0/3004452726 reap_dead start 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 1 -- 10.20.193.104:0/3004452726 shutdown_connections 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 1 -- 10.20.193.104:0/3004452726 >> 10.20.193.104:0/3004452726 conn(0x7f65e0051a50 msgr2=0x7f65e0057880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 1 -- 10.20.193.104:0/3004452726 shutdown_connections 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 1 -- 10.20.193.104:0/3004452726 wait complete. 2026-02-13T08:08:00.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:07:59.976+0000 7f65e84d1640 1 librados: shutdown 2026-02-13T08:08:00.021 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:08:00.021 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T08:08:00.021 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.068+0000 7fdc96ddd640 10 monclient: get_monmap_and_config 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.068+0000 7fdc96ddd640 10 monclient: build_initial_monmap 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.068+0000 7fdc96ddd640 10 monclient: monmap: 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:08:00.075489+0000 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:08:00.075489+0000 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:08:00.079 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:08:00.080 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.068+0000 7fdc96ddd640 1 Processor -- start 2026-02-13T08:08:00.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.068+0000 7fdc96ddd640 1 -- start start 2026-02-13T08:08:00.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.068+0000 7fdc96ddd640 10 monclient: init 2026-02-13T08:08:00.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: _reopen_session rank -1 2026-02-13T08:08:00.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:08:00.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient(hunting): picked mon.noname-a con 0x7fdc90091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:08:00.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient(hunting): picked mon.noname-b con 0x7fdc9013f870 addr v1:10.20.193.104:6790/0 2026-02-13T08:08:00.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient(hunting): picked mon.noname-c con 0x7fdc9013fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:08:00.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9008e5f0 con 0x7fdc90091740 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9008e8d0 con 0x7fdc9013fcd0 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9008ebb0 con 0x7fdc9013f870 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient(hunting): _renew_subs 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient(hunting): authenticate will time out at 585.664474s 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc94b52640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fdc90091740 0x7fdc9013f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44048/0 (socket says 10.20.193.104:44048) 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc94b52640 1 -- 10.20.193.104:0/3262506894 learned_addr learned my addr 10.20.193.104:0/3262506894 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 -- 10.20.193.104:0/3262506894 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2365755172 0 0) 0x7fdc9008e5f0 con 0x7fdc90091740 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient(hunting): my global_id is 26925 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 -- 10.20.193.104:0/3262506894 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc7c003620 con 0x7fdc90091740 2026-02-13T08:08:00.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 -- 10.20.193.104:0/3262506894 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028811988 0 0) 0x7fdc9008ebb0 con 0x7fdc9013f870 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient(hunting): my global_id is 27284 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 -- 10.20.193.104:0/3262506894 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc9008e5f0 con 0x7fdc9013f870 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 -- 10.20.193.104:0/3262506894 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 279175889 0 0) 0x7fdc9008e5f0 con 0x7fdc9013f870 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 -- 10.20.193.104:0/3262506894 >> v1:10.20.193.119:6789/0 conn(0x7fdc9013fcd0 legacy=0x7fdc901a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 -- 10.20.193.104:0/3262506894 >> v1:10.20.193.104:6789/0 conn(0x7fdc90091740 legacy=0x7fdc9013f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient: _finish_hunting 0 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 monclient: found mon.noname-b 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:08:00.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 -- 10.20.193.104:0/3262506894 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc90091b10 con 0x7fdc9013f870 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient: _finish_auth 0 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient: _check_auth_tickets 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 -- 10.20.193.104:0/3262506894 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc78002e00 con 0x7fdc9013f870 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient: dump: 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.092 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 5 monclient: authenticate success, global_id 27284 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 -- 10.20.193.104:0/3262506894 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc78002fd0 con 0x7fdc9013f870 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 1 -- 10.20.193.104:0/3262506894 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc780033a0 con 0x7fdc9013f870 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc877fe640 10 monclient: dump: 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.093 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: get_monmap_and_config success 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 4 set_mon_vals no callback set 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: shutdown 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- 10.20.193.104:0/3262506894 >> v1:10.20.193.104:6790/0 conn(0x7fdc9013f870 legacy=0x7fdc90180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- 10.20.193.104:0/3262506894 shutdown_connections 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- 10.20.193.104:0/3262506894 >> 10.20.193.104:0/3262506894 conn(0x7fdc90090810 msgr2=0x7fdc90090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- 10.20.193.104:0/3262506894 shutdown_connections 2026-02-13T08:08:00.094 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- 10.20.193.104:0/3262506894 wait complete. 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: build_initial_monmap 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: monmap: 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 librados: starting msgr at 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 librados: starting objecter 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 Processor -- start 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- start start 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 librados: setting wanted keys 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 librados: calling monclient init 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: init 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: _reopen_session rank -1 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient(hunting): picked mon.noname-b con 0x7fdc90091740 addr v1:10.20.193.119:6789/0 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient(hunting): picked mon.noname-c con 0x7fdc9013f870 addr v1:10.20.193.104:6790/0 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient(hunting): picked mon.noname-a con 0x7fdc9013fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc9012de60 con 0x7fdc9013fcd0 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc900591b0 con 0x7fdc90091740 2026-02-13T08:08:00.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc901301c0 con 0x7fdc9013f870 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient(hunting): _renew_subs 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient(hunting): authenticate will time out at 585.666834s 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc87fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fdc9013f870 0x7fdc901500d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57898/0 (socket says 10.20.193.104:57898) 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc87fff640 1 -- 10.20.193.104:0/1154425263 learned_addr learned my addr 10.20.193.104:0/1154425263 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 client.?.objecter ms_handle_connect 0x7fdc9013f870 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 client.?.objecter ms_handle_connect 0x7fdc9013fcd0 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1987990207 0 0) 0x7fdc901301c0 con 0x7fdc9013f870 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): my global_id is 27287 2026-02-13T08:08:00.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc60003620 con 0x7fdc9013f870 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 client.?.objecter ms_handle_connect 0x7fdc90091740 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179005779 0 0) 0x7fdc9012de60 con 0x7fdc9013fcd0 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): my global_id is 26928 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc901301c0 con 0x7fdc9013fcd0 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2201223232 0 0) 0x7fdc60003620 con 0x7fdc9013f870 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc9012de60 con 0x7fdc9013f870 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc78002dd0 con 0x7fdc9013f870 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:08:00.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): dump: 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307149066 0 0) 0x7fdc900591b0 con 0x7fdc90091740 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): my global_id is 74152 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc60003620 con 0x7fdc90091740 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3183914041 0 0) 0x7fdc901301c0 con 0x7fdc9013fcd0 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc900591b0 con 0x7fdc9013fcd0 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc8c0033a0 con 0x7fdc9013fcd0 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient(hunting): dump: 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.100 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 851917285 0 0) 0x7fdc9012de60 con 0x7fdc9013f870 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 >> v1:10.20.193.119:6789/0 conn(0x7fdc90091740 legacy=0x7fdc9014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 >> v1:10.20.193.104:6789/0 conn(0x7fdc9013fcd0 legacy=0x7fdc90191d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient: _finish_hunting 0 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 monclient: found mon.c 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9012e9c0 con 0x7fdc9013f870 2026-02-13T08:08:00.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient: _finish_auth 0 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient: _check_auth_tickets 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 5 monclient: authenticate success, global_id 27287 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: _renew_subs 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9012d400 con 0x7fdc9013f870 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc78003b00 con 0x7fdc9013f870 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 client.27287.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: _renew_subs 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc78003f00 con 0x7fdc9013f870 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdc901935f0 con 0x7fdc9013f870 2026-02-13T08:08:00.102 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 librados: init done 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc86ffd640 4 set_mon_vals no callback set 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc857fa640 10 monclient: dump: 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.103 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.072+0000 7fdc96ddd640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdc9008ba00 con 0x7fdc90088990 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 client.27287.objecter ms_handle_connect 0x7fdc90088990 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 client.27287.objecter resend_mon_ops 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fdc780040a0 con 0x7fdc9013f870 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(116..116 src has 1..116) ==== 5123+0+0 (unknown 4114933034 0 0) 0x7fdc7804a8a0 con 0x7fdc9013f870 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 client.27287.objecter ms_dispatch2 0x7fdc90000ba0 osd_map(116..116 src has 1..116) 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 3 client.27287.objecter handle_osd_map got epochs [116,116] > 0 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 3 client.27287.objecter handle_osd_map decoding full epoch 116 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 20 client.27287.objecter dump_active .. 0 homeless 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652471947 0 0) 0x7fdc9008ba00 con 0x7fdc90088990 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 monclient(hunting): my global_id is 27290 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc9012de60 con 0x7fdc90088990 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc95353640 10 monclient: get_auth_request con 0x7fdc6003ba30 auth_method 0 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3755292621 0 0) 0x7fdc9012de60 con 0x7fdc90088990 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc9008ba00 con 0x7fdc90088990 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc80002880 con 0x7fdc90088990 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 monclient: dump: 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.105 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2103129887 0 0) 0x7fdc9008ba00 con 0x7fdc90088990 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc9008ab30 con 0x7fdc90088990 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 client.27287.objecter ms_handle_connect 0x7fdc6003ba30 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7fdc80003530 con 0x7fdc90088990 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 >> v1:10.20.193.104:6790/0 conn(0x7fdc90088990 legacy=0x7fdc9004ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 >> v1:10.20.193.104:6790/0 conn(0x7fdc90088990 legacy=0x7fdc9004ca00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:08:00.106 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.076+0000 7fdc96ddd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdc9008db80 con 0x7fdc90088d60 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 10 client.27287.objecter ms_handle_connect 0x7fdc90088d60 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 10 client.27287.objecter resend_mon_ops 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3631909342 0 0) 0x7fdc9008db80 con 0x7fdc90088d60 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 10 monclient(hunting): my global_id is 27293 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc9008ba00 con 0x7fdc90088d60 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3679602057 0 0) 0x7fdc9008ba00 con 0x7fdc90088d60 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc9008db80 con 0x7fdc90088d60 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc80004a80 con 0x7fdc90088d60 2026-02-13T08:08:00.107 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 10 monclient: dump: 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1219080133 0 0) 0x7fdc9008db80 con 0x7fdc90088d60 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 --> v1:10.20.193.104:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdc9012d7e0 con 0x7fdc90088d60 2026-02-13T08:08:00.108 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4492 (unknown 0 0 3906449725) 0x7fdc80004a10 con 0x7fdc90088d60 2026-02-13T08:08:00.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:08:00.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:08:00.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 >> v1:10.20.193.104:6790/0 conn(0x7fdc90088d60 legacy=0x7fdc90194940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.109 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc857fa640 1 -- 10.20.193.104:0/1154425263 >> v1:10.20.193.104:6790/0 conn(0x7fdc90088d60 legacy=0x7fdc90194940 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:08:00.109 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:08:00.109 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:08:00.109 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:08:00.109 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:08:00.109 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 22, 2026-02-13T08:08:00.109 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 149487, 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 2, 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:00.110 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:00.111 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:08:00.112 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:00.113 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:08:00.114 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:00.115 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.116 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:08:00.117 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: "num": 4 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: "num": 6 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.118 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.119 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.119 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:08:00.119 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:08:00.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 10 librados: watch_flush enter 2026-02-13T08:08:00.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 10 librados: watch_flush exit 2026-02-13T08:08:00.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 20 client.27287.objecter shutdown clearing up homeless session... 2026-02-13T08:08:00.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 10 client.27287.objecter successfully canceled tick 2026-02-13T08:08:00.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 1 -- 10.20.193.104:0/1154425263 >> v1:10.20.193.119:6812/276487904 conn(0x7fdc6003ba30 legacy=0x7fdc6005bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 10 monclient: shutdown 2026-02-13T08:08:00.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:08:00.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 1 -- 10.20.193.104:0/1154425263 >> v1:10.20.193.104:6790/0 conn(0x7fdc9013f870 legacy=0x7fdc901500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.120 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc95353640 1 -- 10.20.193.104:0/1154425263 reap_dead start 2026-02-13T08:08:00.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc95353640 1 -- 10.20.193.104:0/1154425263 reap_dead start 2026-02-13T08:08:00.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 1 -- 10.20.193.104:0/1154425263 shutdown_connections 2026-02-13T08:08:00.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 1 -- 10.20.193.104:0/1154425263 >> 10.20.193.104:0/1154425263 conn(0x7fdc90090810 msgr2=0x7fdc9008cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:08:00.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 1 -- 10.20.193.104:0/1154425263 shutdown_connections 2026-02-13T08:08:00.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 1 -- 10.20.193.104:0/1154425263 wait complete. 2026-02-13T08:08:00.121 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.080+0000 7fdc96ddd640 1 librados: shutdown 2026-02-13T08:08:00.121 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:08:00.121 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T08:08:00.121 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.172+0000 7fd045921640 10 monclient: get_monmap_and_config 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.172+0000 7fd045921640 10 monclient: build_initial_monmap 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.172+0000 7fd045921640 10 monclient: monmap: 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:08:00.179353+0000 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:08:00.179353+0000 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:08:00.183 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.172+0000 7fd045921640 1 Processor -- start 2026-02-13T08:08:00.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.172+0000 7fd045921640 1 -- start start 2026-02-13T08:08:00.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.172+0000 7fd045921640 10 monclient: init 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: _reopen_session rank -1 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient(hunting): picked mon.noname-b con 0x7fd040058970 addr v1:10.20.193.104:6790/0 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient(hunting): picked mon.noname-a con 0x7fd040092c10 addr v1:10.20.193.104:6789/0 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient(hunting): picked mon.noname-c con 0x7fd0401818e0 addr v1:10.20.193.119:6789/0 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04008e450 con 0x7fd040092c10 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04008e8a0 con 0x7fd0401818e0 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04008eb50 con 0x7fd040058970 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient(hunting): _renew_subs 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient(hunting): authenticate will time out at 585.768414s 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd04491f640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fd040058970 0x7fd040059080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57910/0 (socket says 10.20.193.104:57910) 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd04491f640 1 -- 10.20.193.104:0/2143678184 learned_addr learned my addr 10.20.193.104:0/2143678184 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd037fff640 1 --1- 10.20.193.104:0/2143678184 >> v1:10.20.193.104:6789/0 conn(0x7fd040092c10 0x7fd0401801c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44072/0 (socket says 10.20.193.104:44072) 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 -- 10.20.193.104:0/2143678184 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015839908 0 0) 0x7fd04008eb50 con 0x7fd040058970 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient(hunting): my global_id is 27296 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 -- 10.20.193.104:0/2143678184 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd02c003620 con 0x7fd040058970 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 -- 10.20.193.104:0/2143678184 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2144944341 0 0) 0x7fd04008e450 con 0x7fd040092c10 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient(hunting): my global_id is 26931 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 -- 10.20.193.104:0/2143678184 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd04008eb50 con 0x7fd040092c10 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 -- 10.20.193.104:0/2143678184 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3118086224 0 0) 0x7fd02c003620 con 0x7fd040058970 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 -- 10.20.193.104:0/2143678184 >> v1:10.20.193.119:6789/0 conn(0x7fd0401818e0 legacy=0x7fd0401a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 -- 10.20.193.104:0/2143678184 >> v1:10.20.193.104:6789/0 conn(0x7fd040092c10 legacy=0x7fd0401801c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient: _finish_hunting 0 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 monclient: found mon.noname-b 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:08:00.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 -- 10.20.193.104:0/2143678184 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd040059790 con 0x7fd040058970 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient: _finish_auth 0 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient: _check_auth_tickets 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 -- 10.20.193.104:0/2143678184 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd030002e00 con 0x7fd040058970 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient: dump: 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 5 monclient: authenticate success, global_id 27296 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 -- 10.20.193.104:0/2143678184 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd030003040 con 0x7fd040058970 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 1 -- 10.20.193.104:0/2143678184 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd030003480 con 0x7fd040058970 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0377fe640 10 monclient: dump: 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: get_monmap_and_config success 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 4 set_mon_vals no callback set 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: shutdown 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- 10.20.193.104:0/2143678184 >> v1:10.20.193.104:6790/0 conn(0x7fd040058970 legacy=0x7fd040059080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- 10.20.193.104:0/2143678184 shutdown_connections 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- 10.20.193.104:0/2143678184 >> 10.20.193.104:0/2143678184 conn(0x7fd040051c80 msgr2=0x7fd040052080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- 10.20.193.104:0/2143678184 shutdown_connections 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- 10.20.193.104:0/2143678184 wait complete. 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: build_initial_monmap 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: monmap: 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.194 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 librados: starting msgr at 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 librados: starting objecter 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 Processor -- start 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- start start 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 librados: setting wanted keys 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 librados: calling monclient init 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: init 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: _reopen_session rank -1 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient(hunting): picked mon.noname-c con 0x7fd040058970 addr v1:10.20.193.104:6790/0 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient(hunting): picked mon.noname-b con 0x7fd040092c10 addr v1:10.20.193.119:6789/0 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient(hunting): picked mon.noname-a con 0x7fd0401818e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04019e2c0 con 0x7fd0401818e0 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04008a8e0 con 0x7fd040092c10 2026-02-13T08:08:00.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04019f780 con 0x7fd040058970 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient(hunting): _renew_subs 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient(hunting): authenticate will time out at 585.770544s 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd04491f640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fd040058970 0x7fd04019d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57916/0 (socket says 10.20.193.104:57916) 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd04491f640 1 -- 10.20.193.104:0/1223429795 learned_addr learned my addr 10.20.193.104:0/1223429795 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 client.?.objecter ms_handle_connect 0x7fd040058970 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 client.?.objecter ms_handle_connect 0x7fd0401818e0 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1302466255 0 0) 0x7fd04019f780 con 0x7fd040058970 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): my global_id is 27299 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd010003620 con 0x7fd040058970 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451405917 0 0) 0x7fd04019e2c0 con 0x7fd0401818e0 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): my global_id is 26934 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd04019f780 con 0x7fd0401818e0 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 client.?.objecter ms_handle_connect 0x7fd040092c10 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1706496418 0 0) 0x7fd010003620 con 0x7fd040058970 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd04019e2c0 con 0x7fd040058970 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd030003390 con 0x7fd040058970 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): dump: 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.197 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1036007210 0 0) 0x7fd04019f780 con 0x7fd0401818e0 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd010003620 con 0x7fd0401818e0 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd03c0033a0 con 0x7fd0401818e0 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient(hunting): dump: 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.198 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2813264409 0 0) 0x7fd04019e2c0 con 0x7fd040058970 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 >> v1:10.20.193.119:6789/0 conn(0x7fd040092c10 legacy=0x7fd04019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 >> v1:10.20.193.104:6789/0 conn(0x7fd0401818e0 legacy=0x7fd04016fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient: _finish_hunting 0 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 monclient: found mon.c 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04019fd50 con 0x7fd040058970 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient: _finish_auth 0 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient: _check_auth_tickets 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 5 monclient: authenticate success, global_id 27299 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: _renew_subs 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:00.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0401a0030 con 0x7fd040058970 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 client.27299.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: _renew_subs 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd040088d50 con 0x7fd040058970 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 librados: init done 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd030002fc0 con 0x7fd040058970 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd030004cf0 con 0x7fd040058970 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 monclient: dump: 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.200 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd036ffd640 4 set_mon_vals no callback set 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd045921640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd040061860 con 0x7fd0401a35f0 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 client.27299.objecter ms_handle_connect 0x7fd0401a35f0 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 10 client.27299.objecter resend_mon_ops 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.176+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fd030010d00 con 0x7fd040058970 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(117..117 src has 1..117) ==== 5226+0+0 (unknown 2626591250 0 0) 0x7fd03004a830 con 0x7fd040058970 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 10 client.27299.objecter ms_dispatch2 0x7fd040000ba0 osd_map(117..117 src has 1..117) 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 3 client.27299.objecter handle_osd_map got epochs [117,117] > 0 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 3 client.27299.objecter handle_osd_map decoding full epoch 117 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 20 client.27299.objecter dump_active .. 0 homeless 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3754773762 0 0) 0x7fd040061860 con 0x7fd0401a35f0 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 10 monclient(hunting): my global_id is 74161 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd04019e2c0 con 0x7fd0401a35f0 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd045120640 10 monclient: get_auth_request con 0x7fd01003b780 auth_method 0 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1752312565 0 0) 0x7fd04019e2c0 con 0x7fd0401a35f0 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd040061860 con 0x7fd0401a35f0 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd028003030 con 0x7fd0401a35f0 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 10 monclient: dump: 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.202 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.203 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.203 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3897230984 0 0) 0x7fd040061860 con 0x7fd0401a35f0 2026-02-13T08:08:00.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.119:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd0401a0430 con 0x7fd0401a35f0 2026-02-13T08:08:00.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 10 client.27299.objecter ms_handle_connect 0x7fd01003b780 2026-02-13T08:08:00.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7fd028003030 con 0x7fd0401a35f0 2026-02-13T08:08:00.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:00.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:08:00.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 >> v1:10.20.193.119:6789/0 conn(0x7fd0401a35f0 legacy=0x7fd04019a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.180+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 >> v1:10.20.193.119:6789/0 conn(0x7fd0401a35f0 legacy=0x7fd04019a040 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:08:00.204 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:08:00.204 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd04019ae60 con 0x7fd04019edf0 2026-02-13T08:08:00.204 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 10 client.27299.objecter ms_handle_connect 0x7fd04019edf0 2026-02-13T08:08:00.204 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 10 client.27299.objecter resend_mon_ops 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286882459 0 0) 0x7fd04019ae60 con 0x7fd04019edf0 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 10 monclient(hunting): my global_id is 74164 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd040061860 con 0x7fd04019edf0 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2263200597 0 0) 0x7fd040061860 con 0x7fd04019edf0 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd04019ae60 con 0x7fd04019edf0 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd0280048e0 con 0x7fd04019edf0 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 10 monclient: dump: 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.205 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 841618696 0 0) 0x7fd04019ae60 con 0x7fd04019edf0 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 --> v1:10.20.193.119:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd0401756a0 con 0x7fd04019edf0 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4157 (unknown 0 0 2030188421) 0x7fd028005c40 con 0x7fd04019edf0 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 >> v1:10.20.193.119:6789/0 conn(0x7fd04019edf0 legacy=0x7fd04019a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd0357fa640 1 -- 10.20.193.104:0/1223429795 >> v1:10.20.193.119:6789/0 conn(0x7fd04019edf0 legacy=0x7fd04019a750 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:08:00.206 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 22, 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 17211, 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 2, 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:08:00.207 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:00.208 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:08:00.209 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:00.210 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:00.211 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.212 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.213 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:00.214 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout: "num": 3 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:08:00.215 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:08:00.216 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 10 librados: watch_flush enter 2026-02-13T08:08:00.216 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 10 librados: watch_flush exit 2026-02-13T08:08:00.216 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 20 client.27299.objecter shutdown clearing up homeless session... 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 10 client.27299.objecter successfully canceled tick 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 1 -- 10.20.193.104:0/1223429795 >> v1:10.20.193.119:6812/276487904 conn(0x7fd01003b780 legacy=0x7fd01005bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 10 monclient: shutdown 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 1 -- 10.20.193.104:0/1223429795 >> v1:10.20.193.104:6790/0 conn(0x7fd040058970 legacy=0x7fd04019d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045120640 1 -- 10.20.193.104:0/1223429795 reap_dead start 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045120640 1 -- 10.20.193.104:0/1223429795 reap_dead start 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 1 -- 10.20.193.104:0/1223429795 shutdown_connections 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 1 -- 10.20.193.104:0/1223429795 >> 10.20.193.104:0/1223429795 conn(0x7fd040051c80 msgr2=0x7fd0400894b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 1 -- 10.20.193.104:0/1223429795 shutdown_connections 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 1 -- 10.20.193.104:0/1223429795 wait complete. 2026-02-13T08:08:00.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:00.184+0000 7fd045921640 1 librados: shutdown 2026-02-13T08:08:00.217 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:08:00.218 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-13T08:08:00.218 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b'] 2026-02-13T08:08:00.218 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-13T08:08:00.218 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-13T08:08:00.218 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T08:08:00.218 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:08:00.232 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T08:08:00.232 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-13T08:08:00.233 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-13T08:08:00.233 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T08:08:15.234 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-13T08:08:15.234 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-13T08:08:15.235 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T08:08:15.235 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:08:15.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 10 monclient: get_monmap_and_config 2026-02-13T08:08:15.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 10 monclient: build_initial_monmap 2026-02-13T08:08:15.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 10 monclient: monmap: 2026-02-13T08:08:15.298 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:08:15.298 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:15.298 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:08:15.294477+0000 2026-02-13T08:08:15.298 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:08:15.294477+0000 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 1 Processor -- start 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 1 -- start start 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 10 monclient: init 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 10 monclient: _reopen_session rank -1 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:08:15.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 10 monclient(hunting): picked mon.noname-c con 0x7f9b4813c0c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:08:15.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 10 monclient(hunting): picked mon.noname-b con 0x7f9b4813cba0 addr v1:10.20.193.104:6790/0 2026-02-13T08:08:15.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 10 monclient(hunting): picked mon.noname-a con 0x7f9b48181f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:08:15.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4808ee60 con 0x7f9b48181f20 2026-02-13T08:08:15.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b480870f0 con 0x7f9b4813c0c0 2026-02-13T08:08:15.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b48087330 con 0x7f9b4813cba0 2026-02-13T08:08:15.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 10 monclient(hunting): _renew_subs 2026-02-13T08:08:15.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4ff74640 10 monclient(hunting): authenticate will time out at 600.883205s 2026-02-13T08:08:15.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4e4ea640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b481a2300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:15.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4d4e8640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f9b4813cba0 0x7f9b48180800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:59046/0 (socket says 10.20.193.104:59046) 2026-02-13T08:08:15.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.289+0000 7f9b4d4e8640 1 -- 10.20.193.104:0/2776627304 learned_addr learned my addr 10.20.193.104:0/2776627304 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:08:15.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.493+0000 7f9b4e4ea640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b481a2300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:15.902 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:15.897+0000 7f9b4e4ea640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b481a2300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:16.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:16.701+0000 7f9b4e4ea640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b481a2300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:18.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 10 monclient(hunting): tick 2026-02-13T08:08:18.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 10 monclient(hunting): _check_auth_tickets 2026-02-13T08:08:18.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 1 monclient(hunting): continuing hunt 2026-02-13T08:08:18.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T08:08:18.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.104:6790/0 conn(0x7f9b4813cba0 legacy=0x7f9b48180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:18.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.119:6789/0 conn(0x7f9b4813c0c0 legacy=0x7f9b4813c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:18.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b481a2300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:08:18.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:08:18.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 10 monclient(hunting): picked mon.noname-c con 0x7f9b4813c0c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:08:18.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 10 monclient(hunting): picked mon.noname-a con 0x7f9b48181f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:08:18.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 10 monclient(hunting): picked mon.noname-b con 0x7f9b4813cba0 addr v1:10.20.193.104:6790/0 2026-02-13T08:08:18.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 1 -- 10.20.193.104:0/2776627304 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b48140150 con 0x7f9b48181f20 2026-02-13T08:08:18.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 1 -- 10.20.193.104:0/2776627304 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4808ee60 con 0x7f9b4813c0c0 2026-02-13T08:08:18.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 1 -- 10.20.193.104:0/2776627304 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b2c069ff0 con 0x7f9b4813cba0 2026-02-13T08:08:18.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b377fe640 10 monclient(hunting): _renew_subs 2026-02-13T08:08:18.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.289+0000 7f9b4d4e8640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b2c044fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:18.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.493+0000 7f9b4d4e8640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b2c044fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:18.902 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:18.897+0000 7f9b4d4e8640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b2c044fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:19.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:19.701+0000 7f9b4d4e8640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b2c044fd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:20.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 1 -- 10.20.193.104:0/2776627304 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76573088 0 0) 0x7f9b2c069ff0 con 0x7f9b4813cba0 2026-02-13T08:08:20.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient(hunting): _negotiate 2026-02-13T08:08:20.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:20.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:20.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient(hunting): my global_id is 27302 2026-02-13T08:08:20.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 1 -- 10.20.193.104:0/2776627304 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b30003620 con 0x7f9b4813cba0 2026-02-13T08:08:20.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 1 -- 10.20.193.104:0/2776627304 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2823698360 0 0) 0x7f9b30003620 con 0x7f9b4813cba0 2026-02-13T08:08:20.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.119:6789/0 conn(0x7f9b4813c0c0 legacy=0x7f9b2c023800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b2c044fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:08:20.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient: _finish_hunting 0 2026-02-13T08:08:20.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 1 monclient: found mon.noname-b 2026-02-13T08:08:20.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:08:20.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:08:20.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 1 -- 10.20.193.104:0/2776627304 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2c06b290 con 0x7f9b4813cba0 2026-02-13T08:08:20.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient: _finish_auth 0 2026-02-13T08:08:20.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient: _check_auth_tickets 2026-02-13T08:08:20.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:08:20.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 1 -- 10.20.193.104:0/2776627304 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9b44004620 con 0x7f9b4813cba0 2026-02-13T08:08:20.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:08:20.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient: dump: 2026-02-13T08:08:20.286 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.286 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.286 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.286 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.287 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.287 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.287 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.287 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.287 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.287 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 5 monclient: authenticate success, global_id 27302 2026-02-13T08:08:20.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:08:20.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 1 -- 10.20.193.104:0/2776627304 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b44004860 con 0x7f9b4813cba0 2026-02-13T08:08:20.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient: handle_config config(0 keys) 2026-02-13T08:08:20.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 1 -- 10.20.193.104:0/2776627304 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9b44004c70 con 0x7f9b4813cba0 2026-02-13T08:08:20.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:20.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4cce7640 10 monclient: dump: 2026-02-13T08:08:20.288 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.288 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.288 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.288 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.288 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.288 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.289 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.289 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.289 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.289 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient: get_monmap_and_config success 2026-02-13T08:08:20.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 4 set_mon_vals no callback set 2026-02-13T08:08:20.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient: shutdown 2026-02-13T08:08:20.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:08:20.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2776627304 >> v1:10.20.193.104:6790/0 conn(0x7f9b4813cba0 legacy=0x7f9b2c0667d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2776627304 shutdown_connections 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2776627304 >> 10.20.193.104:0/2776627304 conn(0x7f9b48090810 msgr2=0x7f9b48090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2776627304 shutdown_connections 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2776627304 wait complete. 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient: build_initial_monmap 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient: monmap: 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:08:20.290 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 librados: starting msgr at 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 librados: starting objecter 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 Processor -- start 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 -- start start 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 librados: setting wanted keys 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 librados: calling monclient init 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient: init 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient: _reopen_session rank -1 2026-02-13T08:08:20.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient(hunting): picked mon.noname-b con 0x7f9b4813c0c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient(hunting): picked mon.noname-c con 0x7f9b4813cba0 addr v1:10.20.193.104:6790/0 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient(hunting): picked mon.noname-a con 0x7f9b48181f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4808ab30 con 0x7f9b48181f20 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b48088420 con 0x7f9b4813c0c0 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b480891f0 con 0x7f9b4813cba0 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient(hunting): _renew_subs 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4ff74640 10 monclient(hunting): authenticate will time out at 605.867684s 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4e4ea640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b4810dfd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4d4e8640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f9b4813cba0 0x7f9b48180800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:41064/0 (socket says 10.20.193.104:41064) 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b4d4e8640 1 -- 10.20.193.104:0/2358781556 learned_addr learned my addr 10.20.193.104:0/2358781556 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:08:20.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b367fc640 10 client.?.objecter ms_handle_connect 0x7f9b4813cba0 2026-02-13T08:08:20.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.273+0000 7f9b367fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:20.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 client.?.objecter ms_handle_connect 0x7f9b4813c0c0 2026-02-13T08:08:20.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:20.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 982685273 0 0) 0x7f9b48088420 con 0x7f9b4813c0c0 2026-02-13T08:08:20.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient(hunting): _negotiate 2026-02-13T08:08:20.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:20.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:20.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient(hunting): my global_id is 74170 2026-02-13T08:08:20.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b18003620 con 0x7f9b4813c0c0 2026-02-13T08:08:20.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3594787115 0 0) 0x7f9b18003620 con 0x7f9b4813c0c0 2026-02-13T08:08:20.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b48088420 con 0x7f9b4813c0c0 2026-02-13T08:08:20.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9b38002ff0 con 0x7f9b4813c0c0 2026-02-13T08:08:20.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:08:20.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:08:20.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient(hunting): dump: 2026-02-13T08:08:20.294 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.294 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.294 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.294 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.294 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.294 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.294 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3874748186 0 0) 0x7f9b48088420 con 0x7f9b4813c0c0 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 >> v1:10.20.193.104:6790/0 conn(0x7f9b4813cba0 legacy=0x7f9b48180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 >> v1:10.20.193.104:6789/0 conn(0x7f9b48181f20 legacy=0x7f9b4810dfd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient: _finish_hunting 0 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 monclient: found mon.b 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:08:20.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b480894d0 con 0x7f9b4813c0c0 2026-02-13T08:08:20.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient: _finish_auth 0 2026-02-13T08:08:20.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient: _check_auth_tickets 2026-02-13T08:08:20.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:08:20.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 5 monclient: authenticate success, global_id 74170 2026-02-13T08:08:20.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 10 monclient: _renew_subs 2026-02-13T08:08:20.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:08:20.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2358781556 --> v1:10.20.193.119:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b48087840 con 0x7f9b4813c0c0 2026-02-13T08:08:20.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 10 client.74170.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:08:20.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 10 monclient: _renew_subs 2026-02-13T08:08:20.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:08:20.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2358781556 --> v1:10.20.193.119:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b48128510 con 0x7f9b4813c0c0 2026-02-13T08:08:20.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 1 librados: init done 2026-02-13T08:08:20.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:20.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:20.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:08:20.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2358781556 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b48089880 con 0x7f9b4813c0c0 2026-02-13T08:08:20.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 <== mon.1 v1:10.20.193.119:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b38003200 con 0x7f9b4813c0c0 2026-02-13T08:08:20.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:08:20.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 <== mon.1 v1:10.20.193.119:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9b38003590 con 0x7f9b4813c0c0 2026-02-13T08:08:20.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:08:20.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 monclient: dump: 2026-02-13T08:08:20.299 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.299 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.299 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.299 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.299 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.299 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.300 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.300 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.300 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.300 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b37fff640 4 set_mon_vals no callback set 2026-02-13T08:08:20.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 <== mon.1 v1:10.20.193.119:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f9b38003730 con 0x7f9b4813c0c0 2026-02-13T08:08:20.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 <== mon.1 v1:10.20.193.119:6789/0 8 ==== osd_map(117..117 src has 1..117) ==== 5226+0+0 (unknown 2626591250 0 0) 0x7f9b38049600 con 0x7f9b4813c0c0 2026-02-13T08:08:20.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 10 client.74170.objecter ms_dispatch2 0x7f9b48000ba0 osd_map(117..117 src has 1..117) 2026-02-13T08:08:20.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 3 client.74170.objecter handle_osd_map got epochs [117,117] > 0 2026-02-13T08:08:20.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 3 client.74170.objecter handle_osd_map decoding full epoch 117 2026-02-13T08:08:20.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.277+0000 7f9b367fc640 20 client.74170.objecter dump_active .. 0 homeless 2026-02-13T08:08:20.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.281+0000 7f9b4d4e8640 10 monclient: get_auth_request con 0x7f9b1803b740 auth_method 0 2026-02-13T08:08:20.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.281+0000 7f9b367fc640 10 client.74170.objecter ms_handle_connect 0x7f9b1803b740 2026-02-13T08:08:20.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.281+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 <== mon.1 v1:10.20.193.119:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f9b380159c0 con 0x7f9b4813c0c0 2026-02-13T08:08:20.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.281+0000 7f9b367fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:20.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.281+0000 7f9b367fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:08:20.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.397+0000 7f9b4ff74640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:08:20.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.397+0000 7f9b4ff74640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:08:20.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.397+0000 7f9b4ff74640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:08:20.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.397+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2358781556 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9b48060360 con 0x7f9b4813c0c0 2026-02-13T08:08:20.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b367fc640 1 -- 10.20.193.104:0/2358781556 <== mon.1 v1:10.20.193.119:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1469 (unknown 254746657 0 1589372874) 0x7f9b380152c0 con 0x7f9b4813c0c0 2026-02-13T08:08:20.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b367fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:08:20.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b367fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:08:20.408 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":24,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:08:20.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 10 librados: watch_flush enter 2026-02-13T08:08:20.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 10 librados: watch_flush exit 2026-02-13T08:08:20.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 20 client.74170.objecter shutdown clearing up homeless session... 2026-02-13T08:08:20.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 10 client.74170.objecter successfully canceled tick 2026-02-13T08:08:20.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2358781556 >> v1:10.20.193.119:6812/276487904 conn(0x7f9b1803b740 legacy=0x7f9b1805bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 10 monclient: shutdown 2026-02-13T08:08:20.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:08:20.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2358781556 >> v1:10.20.193.119:6789/0 conn(0x7f9b4813c0c0 legacy=0x7f9b48127c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2358781556 shutdown_connections 2026-02-13T08:08:20.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2358781556 >> 10.20.193.104:0/2358781556 conn(0x7f9b48090810 msgr2=0x7f9b4808f190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:08:20.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2358781556 shutdown_connections 2026-02-13T08:08:20.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 1 -- 10.20.193.104:0/2358781556 wait complete. 2026-02-13T08:08:20.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.401+0000 7f9b4ff74640 1 librados: shutdown 2026-02-13T08:08:20.419 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T08:08:20.419 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T08:08:20.419 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T08:08:20.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.473+0000 7fd1f6f03640 10 monclient: get_monmap_and_config 2026-02-13T08:08:20.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.473+0000 7fd1f6f03640 10 monclient: build_initial_monmap 2026-02-13T08:08:20.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.473+0000 7fd1f6f03640 10 monclient: monmap: 2026-02-13T08:08:20.482 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:08:20.482 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.482 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:08:20.479509+0000 2026-02-13T08:08:20.482 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:08:20.479509+0000 2026-02-13T08:08:20.482 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:08:20.482 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.482 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:08:20.482 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:08:20.483 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:08:20.483 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.473+0000 7fd1f6f03640 1 Processor -- start 2026-02-13T08:08:20.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.473+0000 7fd1f6f03640 1 -- start start 2026-02-13T08:08:20.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.473+0000 7fd1f6f03640 10 monclient: init 2026-02-13T08:08:20.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: _reopen_session rank -1 2026-02-13T08:08:20.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:08:20.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient(hunting): picked mon.noname-a con 0x7fd1f013ef60 addr v1:10.20.193.104:6789/0 2026-02-13T08:08:20.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient(hunting): picked mon.noname-b con 0x7fd1f013f330 addr v1:10.20.193.104:6790/0 2026-02-13T08:08:20.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient(hunting): picked mon.noname-c con 0x7fd1f01819c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:08:20.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f013fe80 con 0x7fd1f013ef60 2026-02-13T08:08:20.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f005d8f0 con 0x7fd1f01819c0 2026-02-13T08:08:20.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f005e160 con 0x7fd1f013f330 2026-02-13T08:08:20.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient(hunting): _renew_subs 2026-02-13T08:08:20.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient(hunting): authenticate will time out at 606.068227s 2026-02-13T08:08:20.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f4c78640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7fd1f013ef60 legacy=0x7fd1f008c580 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:20.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e7fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fd1f013f330 0x7fd1f01802a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:41080/0 (socket says 10.20.193.104:41080) 2026-02-13T08:08:20.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e7fff640 1 -- 10.20.193.104:0/2601885955 learned_addr learned my addr 10.20.193.104:0/2601885955 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:08:20.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 1 -- 10.20.193.104:0/2601885955 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 939002175 0 0) 0x7fd1f005e160 con 0x7fd1f013f330 2026-02-13T08:08:20.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient(hunting): _negotiate 2026-02-13T08:08:20.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:20.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:20.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient(hunting): my global_id is 27311 2026-02-13T08:08:20.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 1 -- 10.20.193.104:0/2601885955 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1dc003620 con 0x7fd1f013f330 2026-02-13T08:08:20.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 1 -- 10.20.193.104:0/2601885955 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2949823262 0 0) 0x7fd1dc003620 con 0x7fd1f013f330 2026-02-13T08:08:20.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 1 -- 10.20.193.104:0/2601885955 >> v1:10.20.193.119:6789/0 conn(0x7fd1f01819c0 legacy=0x7fd1f01a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 1 -- 10.20.193.104:0/2601885955 >> v1:10.20.193.104:6789/0 conn(0x7fd1f013ef60 legacy=0x7fd1f008c580 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:08:20.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient: _finish_hunting 0 2026-02-13T08:08:20.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 1 monclient: found mon.noname-b 2026-02-13T08:08:20.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:08:20.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:08:20.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 1 -- 10.20.193.104:0/2601885955 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f005d390 con 0x7fd1f013f330 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient: _finish_auth 0 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient: _check_auth_tickets 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 1 -- 10.20.193.104:0/2601885955 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd1d8002e00 con 0x7fd1f013f330 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient: dump: 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.496 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.497 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.497 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.497 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.497 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.497 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 5 monclient: authenticate success, global_id 27311 2026-02-13T08:08:20.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:08:20.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 1 -- 10.20.193.104:0/2601885955 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1d8003080 con 0x7fd1f013f330 2026-02-13T08:08:20.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:08:20.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 1 -- 10.20.193.104:0/2601885955 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd1d80034c0 con 0x7fd1f013f330 2026-02-13T08:08:20.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e77fe640 10 monclient: dump: 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.498 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: get_monmap_and_config success 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 4 set_mon_vals no callback set 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: shutdown 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2601885955 >> v1:10.20.193.104:6790/0 conn(0x7fd1f013f330 legacy=0x7fd1f01802a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2601885955 shutdown_connections 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2601885955 >> 10.20.193.104:0/2601885955 conn(0x7fd1f008d040 msgr2=0x7fd1f008d410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2601885955 shutdown_connections 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2601885955 wait complete. 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: build_initial_monmap 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: monmap: 2026-02-13T08:08:20.499 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 librados: starting msgr at 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 librados: starting objecter 2026-02-13T08:08:20.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 Processor -- start 2026-02-13T08:08:20.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- start start 2026-02-13T08:08:20.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 librados: setting wanted keys 2026-02-13T08:08:20.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 librados: calling monclient init 2026-02-13T08:08:20.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: init 2026-02-13T08:08:20.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: _reopen_session rank -1 2026-02-13T08:08:20.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:08:20.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient(hunting): picked mon.noname-a con 0x7fd1f013ef60 addr v1:10.20.193.104:6789/0 2026-02-13T08:08:20.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient(hunting): picked mon.noname-b con 0x7fd1f013f330 addr v1:10.20.193.119:6789/0 2026-02-13T08:08:20.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient(hunting): picked mon.noname-c con 0x7fd1f01819c0 addr v1:10.20.193.104:6790/0 2026-02-13T08:08:20.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f4c78640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7fd1f013ef60 legacy=0x7fd1f00773e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:20.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f0078200 con 0x7fd1f013ef60 2026-02-13T08:08:20.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f00799d0 con 0x7fd1f013f330 2026-02-13T08:08:20.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1f00784e0 con 0x7fd1f01819c0 2026-02-13T08:08:20.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient(hunting): _renew_subs 2026-02-13T08:08:20.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient(hunting): authenticate will time out at 606.070620s 2026-02-13T08:08:20.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f5479640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fd1f01819c0 0x7fd1f0180eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:41082/0 (socket says 10.20.193.104:41082) 2026-02-13T08:08:20.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f5479640 1 -- 10.20.193.104:0/2213729612 learned_addr learned my addr 10.20.193.104:0/2213729612 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:08:20.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 client.?.objecter ms_handle_connect 0x7fd1f01819c0 2026-02-13T08:08:20.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:20.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1523240732 0 0) 0x7fd1f00784e0 con 0x7fd1f01819c0 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): my global_id is 27314 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1c0003620 con 0x7fd1f01819c0 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 client.?.objecter ms_handle_connect 0x7fd1f013f330 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3694042463 0 0) 0x7fd1c0003620 con 0x7fd1f01819c0 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1f00784e0 con 0x7fd1f01819c0 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd1ec003470 con 0x7fd1f01819c0 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:08:20.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:08:20.504 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): dump: 2026-02-13T08:08:20.504 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.504 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.504 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.504 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.504 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.504 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.504 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.504 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.504 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.505 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:08:20.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125208782 0 0) 0x7fd1f00799d0 con 0x7fd1f013f330 2026-02-13T08:08:20.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:20.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:20.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:20.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): my global_id is 74182 2026-02-13T08:08:20.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1c0003620 con 0x7fd1f013f330 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4289731033 0 0) 0x7fd1f00784e0 con 0x7fd1f01819c0 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 >> v1:10.20.193.119:6789/0 conn(0x7fd1f013f330 legacy=0x7fd1f0077af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 >> v1:10.20.193.104:6789/0 conn(0x7fd1f013ef60 legacy=0x7fd1f00773e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient: _finish_hunting 0 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 monclient: found mon.c 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f007a840 con 0x7fd1f01819c0 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient: _finish_auth 0 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient: _check_auth_tickets 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 5 monclient: authenticate success, global_id 27314 2026-02-13T08:08:20.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: _renew_subs 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f0079fa0 con 0x7fd1f01819c0 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 client.27314.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: _renew_subs 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd1f01815c0 con 0x7fd1f01819c0 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 librados: init done 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1ec003820 con 0x7fd1f01819c0 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd1ec003ee0 con 0x7fd1f01819c0 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e6ffd640 4 set_mon_vals no callback set 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient: dump: 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.508 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:20.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd1f0061860 con 0x7fd1f01a34c0 2026-02-13T08:08:20.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 client.27314.objecter ms_handle_connect 0x7fd1f01a34c0 2026-02-13T08:08:20.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 client.27314.objecter resend_mon_ops 2026-02-13T08:08:20.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3280612210 0 0) 0x7fd1f0061860 con 0x7fd1f01a34c0 2026-02-13T08:08:20.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:20.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:20.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:20.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 10 monclient(hunting): my global_id is 27317 2026-02-13T08:08:20.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.477+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1f00784e0 con 0x7fd1f01a34c0 2026-02-13T08:08:20.509 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fd1ec004080 con 0x7fd1f01819c0 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(118..118 src has 1..118) ==== 5134+0+0 (unknown 508171833 0 0) 0x7fd1ec04ab10 con 0x7fd1f01819c0 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 10 client.27314.objecter ms_dispatch2 0x7fd1f0000ba0 osd_map(118..118 src has 1..118) 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 3 client.27314.objecter handle_osd_map got epochs [118,118] > 0 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 3 client.27314.objecter handle_osd_map decoding full epoch 118 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 20 client.27314.objecter dump_active .. 0 homeless 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2431609483 0 0) 0x7fd1f00784e0 con 0x7fd1f01a34c0 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1f0061860 con 0x7fd1f01a34c0 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd1e0003f60 con 0x7fd1f01a34c0 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 10 monclient: dump: 2026-02-13T08:08:20.510 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.511 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.511 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.511 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.511 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.511 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.511 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.511 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.511 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.511 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.511 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e7fff640 10 monclient: get_auth_request con 0x7fd1c003b900 auth_method 0 2026-02-13T08:08:20.511 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2479476773 0 0) 0x7fd1f0061860 con 0x7fd1f01a34c0 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd1f013c1e0 con 0x7fd1f01a34c0 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 10 client.27314.objecter ms_handle_connect 0x7fd1c003b900 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7fd1e0005510 con 0x7fd1f01a34c0 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 >> v1:10.20.193.104:6790/0 conn(0x7fd1f01a34c0 legacy=0x7fd1f0088290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 >> v1:10.20.193.104:6790/0 conn(0x7fd1f01a34c0 legacy=0x7fd1f0088290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1f6f03640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.481+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd1f00890b0 con 0x7fd1f013c390 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 10 client.27314.objecter ms_handle_connect 0x7fd1f013c390 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 10 client.27314.objecter resend_mon_ops 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 446902807 0 0) 0x7fd1f00890b0 con 0x7fd1f013c390 2026-02-13T08:08:20.512 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 10 monclient(hunting): _negotiate 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 10 monclient(hunting): my global_id is 27320 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1f0061860 con 0x7fd1f013c390 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1123654336 0 0) 0x7fd1f0061860 con 0x7fd1f013c390 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1f00890b0 con 0x7fd1f013c390 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd1e0004380 con 0x7fd1f013c390 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 10 monclient: dump: 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.513 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1843982096 0 0) 0x7fd1f00890b0 con 0x7fd1f013c390 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 --> v1:10.20.193.104:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd1f012d8f0 con 0x7fd1f013c390 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4481 (unknown 0 0 2484931104) 0x7fd1e0005790 con 0x7fd1f013c390 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:08:20.514 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:08:20.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 >> v1:10.20.193.104:6790/0 conn(0x7fd1f013c390 legacy=0x7fd1f00889a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1e57fa640 1 -- 10.20.193.104:0/2213729612 >> v1:10.20.193.104:6790/0 conn(0x7fd1f013c390 legacy=0x7fd1f00889a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:08:20.515 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:08:20.515 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:08:20.515 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:08:20.515 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:08:20.516 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 24, 2026-02-13T08:08:20.516 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 169892, 2026-02-13T08:08:20.516 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:08:20.516 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:08:20.516 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:08:20.516 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:20.516 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:08:20.516 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:08:20.516 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:08:20.516 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:08:20.516 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:20.517 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:20.517 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:20.517 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:20.517 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:20.517 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:20.517 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:20.517 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:20.517 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:20.517 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:20.517 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:20.518 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:08:20.519 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:20.520 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:08:20.521 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:20.522 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.523 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.524 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:20.525 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.526 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:20.527 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:08:20.527 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.527 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:20.527 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:20.527 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:08:20.527 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.527 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.527 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.527 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:08:20.527 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 10 librados: watch_flush enter 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 10 librados: watch_flush exit 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 20 client.27314.objecter shutdown clearing up homeless session... 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 10 client.27314.objecter successfully canceled tick 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2213729612 >> v1:10.20.193.119:6812/276487904 conn(0x7fd1c003b900 legacy=0x7fd1c005bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 10 monclient: shutdown 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2213729612 >> v1:10.20.193.104:6790/0 conn(0x7fd1f01819c0 legacy=0x7fd1f0180eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f5479640 1 -- 10.20.193.104:0/2213729612 reap_dead start 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f5479640 1 -- 10.20.193.104:0/2213729612 reap_dead start 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2213729612 shutdown_connections 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2213729612 >> 10.20.193.104:0/2213729612 conn(0x7fd1f008d040 msgr2=0x7fd1f008e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2213729612 shutdown_connections 2026-02-13T08:08:20.529 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 1 -- 10.20.193.104:0/2213729612 wait complete. 2026-02-13T08:08:20.530 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.485+0000 7fd1f6f03640 1 librados: shutdown 2026-02-13T08:08:20.530 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T08:08:20.530 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T08:08:20.530 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T08:08:20.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.581+0000 7f4e7e0f2640 10 monclient: get_monmap_and_config 2026-02-13T08:08:20.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.581+0000 7f4e7e0f2640 10 monclient: build_initial_monmap 2026-02-13T08:08:20.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.581+0000 7f4e7e0f2640 10 monclient: monmap: 2026-02-13T08:08:20.590 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:08:20.590 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.590 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:08:20.587526+0000 2026-02-13T08:08:20.590 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:08:20.587526+0000 2026-02-13T08:08:20.590 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:08:20.590 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.590 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:08:20.590 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:08:20.590 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:08:20.590 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.581+0000 7f4e7e0f2640 1 Processor -- start 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.581+0000 7f4e7e0f2640 1 -- start start 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.581+0000 7f4e7e0f2640 10 monclient: init 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: _reopen_session rank -1 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient(hunting): picked mon.noname-a con 0x7f4e7805c220 addr v1:10.20.193.104:6789/0 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient(hunting): picked mon.noname-c con 0x7f4e7805cd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient(hunting): picked mon.noname-b con 0x7f4e78181d90 addr v1:10.20.193.104:6790/0 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7808fa20 con 0x7f4e7805c220 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7808f7a0 con 0x7f4e7805cd00 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7808c960 con 0x7f4e78181d90 2026-02-13T08:08:20.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient(hunting): _renew_subs 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient(hunting): authenticate will time out at 606.176231s 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e777fe640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7f4e7805c220 legacy=0x7f4e7805c5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e77fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f4e78181d90 0x7f4e781a2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:41114/0 (socket says 10.20.193.104:41114) 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e77fff640 1 -- 10.20.193.104:0/3878386157 learned_addr learned my addr 10.20.193.104:0/3878386157 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 1 -- 10.20.193.104:0/3878386157 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3376504096 0 0) 0x7f4e7808c960 con 0x7f4e78181d90 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient(hunting): _negotiate 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient(hunting): my global_id is 27323 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 1 -- 10.20.193.104:0/3878386157 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e5c003620 con 0x7f4e78181d90 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 1 -- 10.20.193.104:0/3878386157 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1872835896 0 0) 0x7f4e5c003620 con 0x7f4e78181d90 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 1 -- 10.20.193.104:0/3878386157 >> v1:10.20.193.119:6789/0 conn(0x7f4e7805cd00 legacy=0x7f4e78180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 1 -- 10.20.193.104:0/3878386157 >> v1:10.20.193.104:6789/0 conn(0x7f4e7805c220 legacy=0x7f4e7805c5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:08:20.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient: _finish_hunting 0 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 1 monclient: found mon.noname-b 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 1 -- 10.20.193.104:0/3878386157 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7808a7c0 con 0x7f4e78181d90 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient: _finish_auth 0 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient: _check_auth_tickets 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 1 -- 10.20.193.104:0/3878386157 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e6c003180 con 0x7f4e78181d90 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient: dump: 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.599 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 5 monclient: authenticate success, global_id 27323 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 1 -- 10.20.193.104:0/3878386157 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e6c003390 con 0x7f4e78181d90 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 1 -- 10.20.193.104:0/3878386157 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e6c0037d0 con 0x7f4e78181d90 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e767fc640 10 monclient: dump: 2026-02-13T08:08:20.600 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: get_monmap_and_config success 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 4 set_mon_vals no callback set 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: shutdown 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:08:20.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/3878386157 >> v1:10.20.193.104:6790/0 conn(0x7f4e78181d90 legacy=0x7f4e781a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/3878386157 shutdown_connections 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/3878386157 >> 10.20.193.104:0/3878386157 conn(0x7f4e78090240 msgr2=0x7f4e7808db40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/3878386157 shutdown_connections 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/3878386157 wait complete. 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: build_initial_monmap 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: monmap: 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:08:20.602 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 librados: starting msgr at 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 librados: starting objecter 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 Processor -- start 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- start start 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 librados: setting wanted keys 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 librados: calling monclient init 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: init 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: _reopen_session rank -1 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient(hunting): picked mon.noname-c con 0x7f4e7805c220 addr v1:10.20.193.104:6790/0 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient(hunting): picked mon.noname-b con 0x7f4e7805cd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient(hunting): picked mon.noname-a con 0x7f4e78181d90 addr v1:10.20.193.104:6789/0 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e78129810 con 0x7f4e78181d90 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7805d760 con 0x7f4e7805cd00 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e78126d60 con 0x7f4e7805c220 2026-02-13T08:08:20.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient(hunting): _renew_subs 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient(hunting): authenticate will time out at 606.178038s 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e77fff640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7f4e78181d90 legacy=0x7f4e7812e610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e777fe640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f4e7805c220 0x7f4e7819c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:41118/0 (socket says 10.20.193.104:41118) 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e777fe640 1 -- 10.20.193.104:0/1054373776 learned_addr learned my addr 10.20.193.104:0/1054373776 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 client.?.objecter ms_handle_connect 0x7f4e7805c220 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644883979 0 0) 0x7f4e78126d60 con 0x7f4e7805c220 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): _negotiate 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): my global_id is 27326 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e48003620 con 0x7f4e7805c220 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 client.?.objecter ms_handle_connect 0x7f4e7805cd00 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:08:20.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1233106846 0 0) 0x7f4e48003620 con 0x7f4e7805c220 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e78126d60 con 0x7f4e7805c220 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e640042b0 con 0x7f4e7805c220 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): dump: 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1082589494 0 0) 0x7f4e78126d60 con 0x7f4e7805c220 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 >> v1:10.20.193.119:6789/0 conn(0x7f4e7805cd00 legacy=0x7f4e78180670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 >> v1:10.20.193.104:6789/0 conn(0x7f4e78181d90 legacy=0x7f4e7812e610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient: _finish_hunting 0 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 monclient: found mon.c 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e78127d50 con 0x7f4e7805c220 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient: _finish_auth 0 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient: _check_auth_tickets 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 5 monclient: authenticate success, global_id 27326 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: _renew_subs 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7819d070 con 0x7f4e7805c220 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 client.27326.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: _renew_subs 2026-02-13T08:08:20.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4e78126930 con 0x7f4e7805c220 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 librados: init done 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e64004530 con 0x7f4e7805c220 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e64004940 con 0x7f4e7805c220 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e75ffb640 4 set_mon_vals no callback set 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient: dump: 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.607 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4e78128c80 con 0x7f4e781288b0 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f4e64004ae0 con 0x7f4e7805c220 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(118..118 src has 1..118) ==== 5134+0+0 (unknown 508171833 0 0) 0x7f4e6404a8e0 con 0x7f4e7805c220 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 client.27326.objecter ms_dispatch2 0x7f4e78000ba0 osd_map(118..118 src has 1..118) 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 3 client.27326.objecter handle_osd_map got epochs [118,118] > 0 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 3 client.27326.objecter handle_osd_map decoding full epoch 118 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 20 client.27326.objecter dump_active .. 0 homeless 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 client.27326.objecter ms_handle_connect 0x7f4e781288b0 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 client.27326.objecter resend_mon_ops 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4240215748 0 0) 0x7f4e78128c80 con 0x7f4e781288b0 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): _negotiate 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:20.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient(hunting): my global_id is 74188 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e78126d60 con 0x7f4e781288b0 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e77fff640 10 monclient: get_auth_request con 0x7f4e4803b700 auth_method 0 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1687242395 0 0) 0x7f4e78126d60 con 0x7f4e781288b0 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e78128c80 con 0x7f4e781288b0 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e68002ca0 con 0x7f4e781288b0 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 monclient: dump: 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.609 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.610 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.610 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.610 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 10 client.27326.objecter ms_handle_connect 0x7f4e4803b700 2026-02-13T08:08:20.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 252197293 0 0) 0x7f4e78128c80 con 0x7f4e781288b0 2026-02-13T08:08:20.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.585+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.119:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e78061860 con 0x7f4e781288b0 2026-02-13T08:08:20.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f4e68002dc0 con 0x7f4e781288b0 2026-02-13T08:08:20.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:08:20.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:08:20.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 >> v1:10.20.193.119:6789/0 conn(0x7f4e781288b0 legacy=0x7f4e7819f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 >> v1:10.20.193.119:6789/0 conn(0x7f4e781288b0 legacy=0x7f4e7819f6b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e7e0f2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4e78129af0 con 0x7f4e7804ca00 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 10 client.27326.objecter ms_handle_connect 0x7f4e7804ca00 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 10 client.27326.objecter resend_mon_ops 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3323671357 0 0) 0x7f4e78129af0 con 0x7f4e7804ca00 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 10 monclient(hunting): _negotiate 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 10 monclient(hunting): my global_id is 74191 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.589+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e78128c80 con 0x7f4e7804ca00 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3167912057 0 0) 0x7f4e78128c80 con 0x7f4e7804ca00 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e78129af0 con 0x7f4e7804ca00 2026-02-13T08:08:20.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4e68003500 con 0x7f4e7804ca00 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 10 monclient: dump: 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:08:20.613 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:08:20.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2435123565 0 0) 0x7f4e78129af0 con 0x7f4e7804ca00 2026-02-13T08:08:20.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 --> v1:10.20.193.119:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4e7804cdd0 con 0x7f4e7804ca00 2026-02-13T08:08:20.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4315 (unknown 0 0 1626423523) 0x7f4e68005aa0 con 0x7f4e7804ca00 2026-02-13T08:08:20.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:08:20.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:08:20.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 >> v1:10.20.193.119:6789/0 conn(0x7f4e7804ca00 legacy=0x7f4e78130d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e53fff640 1 -- 10.20.193.104:0/1054373776 >> v1:10.20.193.119:6789/0 conn(0x7f4e7804ca00 legacy=0x7f4e78130d40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:08:20.614 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:08:20.614 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:08:20.614 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 24, 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 37615, 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:20.615 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:20.616 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:08:20.617 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:08:20.618 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:20.619 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.620 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:20.621 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:08:20.622 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:20.623 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:08:20.624 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:08:20.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 10 librados: watch_flush enter 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 10 librados: watch_flush exit 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 20 client.27326.objecter shutdown clearing up homeless session... 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 10 client.27326.objecter successfully canceled tick 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/1054373776 >> v1:10.20.193.119:6812/276487904 conn(0x7f4e4803b700 legacy=0x7f4e4805bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 10 monclient: shutdown 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/1054373776 >> v1:10.20.193.104:6790/0 conn(0x7f4e7805c220 legacy=0x7f4e7819c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e77fff640 1 -- 10.20.193.104:0/1054373776 reap_dead start 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e77fff640 1 -- 10.20.193.104:0/1054373776 reap_dead start 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/1054373776 shutdown_connections 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/1054373776 >> 10.20.193.104:0/1054373776 conn(0x7f4e78090240 msgr2=0x7f4e78085e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/1054373776 shutdown_connections 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 1 -- 10.20.193.104:0/1054373776 wait complete. 2026-02-13T08:08:20.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:08:20.593+0000 7f4e7e0f2640 1 librados: shutdown 2026-02-13T08:08:20.626 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T08:08:20.627 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T08:08:27.244 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: Running main() from gmock_main.cc 2026-02-13T08:08:27.244 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [==========] Running 63 tests from 5 test suites. 2026-02-13T08:08:27.244 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] Global test environment set-up. 2026-02-13T08:08:27.244 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2026-02-13T08:08:27.244 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2026-02-13T08:08:27.244 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (2982 ms) 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (21954 ms) 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (6004 ms) 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (3008 ms) 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (3002 ms) 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2988 ms) 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2026-02-13T08:08:27.245 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3004 ms) 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3006 ms) 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (2991 ms) 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3004 ms) 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3004 ms) 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (2989 ms) 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3004 ms) 2026-02-13T08:08:27.246 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3004 ms) 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3002 ms) 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (2994 ms) 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (2997 ms) 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3005 ms) 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (2999 ms) 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2026-02-13T08:08:27.247 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3008 ms) 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3008 ms) 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (2979 ms) 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (7510 ms) 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (8999 ms) 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (22237 ms) 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3004 ms) 2026-02-13T08:08:27.248 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2026-02-13T08:08:50.298 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAist: : entry=7 expected=7 2026-02-13T08:08:50.298 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:f905c69b:::2:head 2026-02-13T08:08:50.298 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:f905c69b:::2:head expected=10:f905c69b:::2:head 2026-02-13T08:08:50.299 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:f905c69b:::2:head -> 2 2026-02-13T08:08:50.299 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=2 expected=2 2026-02-13T08:08:50.299 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:e960b815:::9:head 2026-02-13T08:08:50.299 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:e960b815:::9:head expected=10:e960b815:::9:head 2026-02-13T08:08:50.299 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:e960b815:::9:head -> 9 2026-02-13T08:08:50.299 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=9 expected=9 2026-02-13T08:08:50.299 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:de5d7c5f:::12:head 2026-02-13T08:08:50.299 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:de5d7c5f:::12:head expected=10:de5d7c5f:::12:head 2026-02-13T08:08:50.299 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:de5d7c5f:::12:head -> 12 2026-02-13T08:08:50.299 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=12 expected=12 2026-02-13T08:08:50.299 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:d83876eb:::4:head 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:d83876eb:::4:head expected=10:d83876eb:::4:head 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:d83876eb:::4:head -> 4 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=4 expected=4 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:cfc208b3:::3:head 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:cfc208b3:::3:head expected=10:cfc208b3:::3:head 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:cfc208b3:::3:head -> 3 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=3 expected=3 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:c4fdafeb:::6:head 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:c4fdafeb:::6:head expected=10:c4fdafeb:::6:head 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:c4fdafeb:::6:head -> 6 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=6 expected=6 2026-02-13T08:08:50.300 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:bd63b0f1:::8:head 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:bd63b0f1:::8:head expected=10:bd63b0f1:::8:head 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:bd63b0f1:::8:head -> 8 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=8 expected=8 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : seek to 10:62a1935d:::14:head 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : cursor()=10:62a1935d:::14:head expected=10:62a1935d:::14:head 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: > 10:62a1935d:::14:head -> 14 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: : entry=14 expected=14 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (144 ms) 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (138251 ms) 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: split 0/5 -> MIN 10:33333333::::head 2026-02-13T08:08:50.301 INFO:tasks.workunit.client.0.trial119.stdout: api_list: split 1/5 -> 10:33333333::::head 10:66666666::::head 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: split 2/5 -> 10:66666666::::head 10:99999999::::head 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: split 3/5 -> 10:99999999::::head 10:cccccccc::::head 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: split 4/5 -> 10:cccccccc::::head MAX 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (10007 ms) 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [----------] 7 tests from LibRadosList (148653 ms total) 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [----------] 3 tests from LibRadosListEC 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1017 ms) 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: myset foo1,foo2,foo3 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo1 2026-02-13T08:08:50.302 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo2 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo3 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: myset foo1,foo4,foo5 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo4 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo5 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo1 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: myset foo6,foo7 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo7 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: foo6 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: ns1:foo4 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: ns1:foo5 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: ns2:foo7 2026-02-13T08:08:50.303 INFO:tasks.workunit.client.0.trial119.stdout: api_list: ns2:foo6 2026-02-13T08:08:50.304 INFO:tasks.workunit.client.0.trial119.stdout: api_list: ns1:foo1 2026-02-13T08:08:50.304 INFO:tasks.workunit.client.0.trial119.stdout: api_list: :foo1 2026-02-13T08:08:50.304 INFO:tasks.workunit.client.0.trial119.stdout: api_list: :foo2 2026-02-13T08:08:50.304 INFO:tasks.workunit.client.0.trial119.stdout: api_list: :foo3 2026-02-13T08:08:50.304 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (24 ms) 2026-02-13T08:08:56.256 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2026-02-13T08:08:56.256 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 1 0 2026-02-13T08:08:56.256 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 10 0 2026-02-13T08:08:56.256 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 13 0 2026-02-13T08:08:56.256 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 7 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 14 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 0 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 15 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 11 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 5 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 8 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 6 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 3 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 4 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 12 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 9 0 2026-02-13T08:08:56.257 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 2 0 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (35 ms) 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [----------] 3 tests from LibRadosListEC (1077 ms total) 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [----------] 1 test from LibRadosListNP 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (2986 ms) 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [----------] 1 test from LibRadosListNP (2986 ms total) 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [----------] Global test environment tear-down 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [==========] 11 tests from 3 test suites ran. (161594 ms total) 2026-02-13T08:08:56.258 INFO:tasks.workunit.client.0.trial119.stdout: api_list: [ PASSED ] 11 tests. 2026-02-13T08:09:50.627 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T08:09:50.627 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T08:09:50.628 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T08:09:50.630 INFO:tasks.ceph.mon.a:Started 2026-02-13T08:09:50.630 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-13T08:09:50.630 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-13T08:09:50.630 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T08:10:05.631 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-13T08:10:05.632 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-13T08:10:05.632 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T08:10:05.632 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:10:05.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.699+0000 7f0e23fb0640 10 monclient: get_monmap_and_config 2026-02-13T08:10:05.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.699+0000 7f0e23fb0640 10 monclient: build_initial_monmap 2026-02-13T08:10:05.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.699+0000 7f0e23fb0640 10 monclient: monmap: 2026-02-13T08:10:05.701 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:05.701 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.701 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:05.703251+0000 2026-02-13T08:10:05.702 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:05.703251+0000 2026-02-13T08:10:05.702 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:05.702 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.702 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:05.702 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:05.702 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:05.702 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.699+0000 7f0e23fb0640 1 Processor -- start 2026-02-13T08:10:05.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.699+0000 7f0e23fb0640 1 -- start start 2026-02-13T08:10:05.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.699+0000 7f0e23fb0640 10 monclient: init 2026-02-13T08:10:05.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e23fb0640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:05.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e23fb0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:10:05.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e23fb0640 10 monclient(hunting): picked mon.noname-b con 0x7f0e1c08e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:05.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e23fb0640 10 monclient(hunting): picked mon.noname-c con 0x7f0e1c08ef90 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:05.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e23fb0640 10 monclient(hunting): picked mon.noname-a con 0x7f0e1c17ee40 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:05.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e23fb0640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c08b8e0 con 0x7f0e1c17ee40 2026-02-13T08:10:05.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e23fb0640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c087de0 con 0x7f0e1c08ef90 2026-02-13T08:10:05.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e23fb0640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c088be0 con 0x7f0e1c08e4b0 2026-02-13T08:10:05.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e23fb0640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:05.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e23fb0640 10 monclient(hunting): authenticate will time out at 711.292248s 2026-02-13T08:10:05.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e21d25640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f0e1c08e4b0 0x7f0e1c08e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47344/0 (socket says 10.20.193.104:47344) 2026-02-13T08:10:05.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.703+0000 7f0e21d25640 1 -- 10.20.193.104:0/655252336 learned_addr learned my addr 10.20.193.104:0/655252336 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:05.727 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 1 -- 10.20.193.104:0/655252336 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124480640 0 0) 0x7f0e1c088be0 con 0x7f0e1c08e4b0 2026-02-13T08:10:05.727 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient(hunting): _negotiate 2026-02-13T08:10:05.727 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:05.727 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient(hunting): my global_id is 27521 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 1 -- 10.20.193.104:0/655252336 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e04003620 con 0x7f0e1c08e4b0 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 1 -- 10.20.193.104:0/655252336 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1677565199 0 0) 0x7f0e04003620 con 0x7f0e1c08e4b0 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 1 -- 10.20.193.104:0/655252336 >> v1:10.20.193.119:6789/0 conn(0x7f0e1c08ef90 legacy=0x7f0e1c17d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 1 -- 10.20.193.104:0/655252336 >> v1:10.20.193.104:6789/0 conn(0x7f0e1c17ee40 legacy=0x7f0e1c19f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient: _finish_hunting 0 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 1 monclient: found mon.noname-b 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 1 -- 10.20.193.104:0/655252336 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c087b00 con 0x7f0e1c08e4b0 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient: _finish_auth 0 2026-02-13T08:10:05.728 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient: _check_auth_tickets 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 1 -- 10.20.193.104:0/655252336 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0e0c002e00 con 0x7f0e1c08e4b0 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient: dump: 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:05.729 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e23fb0640 5 monclient: authenticate success, global_id 27521 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e23fb0640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 1 -- 10.20.193.104:0/655252336 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e0c003080 con 0x7f0e1c08e4b0 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 1 -- 10.20.193.104:0/655252336 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0e0c0034c0 con 0x7f0e1c08e4b0 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e20d23640 10 monclient: dump: 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:05.730 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e23fb0640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e23fb0640 4 set_mon_vals no callback set 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e23fb0640 10 monclient: shutdown 2026-02-13T08:10:05.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e23fb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e23fb0640 1 -- 10.20.193.104:0/655252336 >> v1:10.20.193.104:6790/0 conn(0x7f0e1c08e4b0 legacy=0x7f0e1c08e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e23fb0640 1 -- 10.20.193.104:0/655252336 shutdown_connections 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e23fb0640 1 -- 10.20.193.104:0/655252336 >> 10.20.193.104:0/655252336 conn(0x7f0e1c051e80 msgr2=0x7f0e1c08c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e23fb0640 1 -- 10.20.193.104:0/655252336 shutdown_connections 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.723+0000 7f0e23fb0640 1 -- 10.20.193.104:0/655252336 wait complete. 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient: build_initial_monmap 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient: monmap: 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:05.732 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 librados: starting msgr at 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 librados: starting objecter 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 Processor -- start 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 -- start start 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 librados: setting wanted keys 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 librados: calling monclient init 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient: init 2026-02-13T08:10:05.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient(hunting): picked mon.noname-c con 0x7f0e1c08e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient(hunting): picked mon.noname-b con 0x7f0e1c08ef90 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient(hunting): picked mon.noname-a con 0x7f0e1c17ee40 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c05b0a0 con 0x7f0e1c17ee40 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c086790 con 0x7f0e1c08ef90 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e1c0862e0 con 0x7f0e1c08e4b0 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient(hunting): authenticate will time out at 711.316763s 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e21d25640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f0e1c08e4b0 0x7f0e1c19a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47356/0 (socket says 10.20.193.104:47356) 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e21d25640 1 -- 10.20.193.104:0/1373227711 learned_addr learned my addr 10.20.193.104:0/1373227711 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e22526640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f0e1c17ee40 0x7f0e1c082ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:50212/0 (socket says 10.20.193.104:50212) 2026-02-13T08:10:05.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 client.?.objecter ms_handle_connect 0x7f0e1c08e4b0 2026-02-13T08:10:05.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:05.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 client.?.objecter ms_handle_connect 0x7f0e1c17ee40 2026-02-13T08:10:05.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:05.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 client.?.objecter ms_handle_connect 0x7f0e1c08ef90 2026-02-13T08:10:05.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:05.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1640140611 0 0) 0x7f0e1c086790 con 0x7f0e1c08ef90 2026-02-13T08:10:05.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:05.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:05.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:05.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): my global_id is 74410 2026-02-13T08:10:05.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dec003620 con 0x7f0e1c08ef90 2026-02-13T08:10:05.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1318366255 0 0) 0x7f0dec003620 con 0x7f0e1c08ef90 2026-02-13T08:10:05.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e1c086790 con 0x7f0e1c08ef90 2026-02-13T08:10:05.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0e100030a0 con 0x7f0e1c08ef90 2026-02-13T08:10:05.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:05.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): dump: 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.740 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779353696 0 0) 0x7f0e1c05b0a0 con 0x7f0e1c17ee40 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient(hunting): my global_id is 84099 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dec003620 con 0x7f0e1c17ee40 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1395479665 0 0) 0x7f0e1c086790 con 0x7f0e1c08ef90 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 >> v1:10.20.193.104:6790/0 conn(0x7f0e1c08e4b0 legacy=0x7f0e1c19a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 >> v1:10.20.193.104:6789/0 conn(0x7f0e1c17ee40 legacy=0x7f0e1c082ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient: _finish_hunting 0 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 monclient: found mon.b 2026-02-13T08:10:05.741 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c18b140 con 0x7f0e1c08ef90 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient: _finish_auth 0 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient: _check_auth_tickets 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 5 monclient: authenticate success, global_id 74410 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient: _renew_subs 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 -- 10.20.193.104:0/1373227711 --> v1:10.20.193.119:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1c184130 con 0x7f0e1c08ef90 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 client.74410.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient: _renew_subs 2026-02-13T08:10:05.742 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 -- 10.20.193.104:0/1373227711 --> v1:10.20.193.119:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e1c059f10 con 0x7f0e1c08ef90 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 librados: init done 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 <== mon.1 v1:10.20.193.119:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e10003450 con 0x7f0e1c08ef90 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 <== mon.1 v1:10.20.193.119:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0e10003b60 con 0x7f0e1c08ef90 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0a7fc640 10 monclient: dump: 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.743 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e0bfff640 4 set_mon_vals no callback set 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.727+0000 7f0e23fb0640 1 -- 10.20.193.104:0/1373227711 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1c1880d0 con 0x7f0e1c08ef90 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.731+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 <== mon.1 v1:10.20.193.119:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f0e10003d00 con 0x7f0e1c08ef90 2026-02-13T08:10:05.744 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.731+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 <== mon.1 v1:10.20.193.119:6789/0 8 ==== osd_map(209..209 src has 1..209) ==== 4739+0+0 (unknown 3756314505 0 0) 0x7f0e100494e0 con 0x7f0e1c08ef90 2026-02-13T08:10:05.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.731+0000 7f0e0a7fc640 10 client.74410.objecter ms_dispatch2 0x7f0e1c000ba0 osd_map(209..209 src has 1..209) 2026-02-13T08:10:05.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.731+0000 7f0e0a7fc640 3 client.74410.objecter handle_osd_map got epochs [209,209] > 0 2026-02-13T08:10:05.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.731+0000 7f0e0a7fc640 3 client.74410.objecter handle_osd_map decoding full epoch 209 2026-02-13T08:10:05.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.731+0000 7f0e0a7fc640 20 client.74410.objecter dump_active .. 0 homeless 2026-02-13T08:10:05.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.731+0000 7f0e21d25640 10 monclient: get_auth_request con 0x7f0dec03b9b0 auth_method 0 2026-02-13T08:10:05.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.731+0000 7f0e0a7fc640 10 client.74410.objecter ms_handle_connect 0x7f0dec03b9b0 2026-02-13T08:10:05.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.731+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 <== mon.1 v1:10.20.193.119:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f0e1c087de0 con 0x7f0e1c08ef90 2026-02-13T08:10:05.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.731+0000 7f0e0a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:05.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.731+0000 7f0e0a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:05.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.843+0000 7f0e23fb0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:10:05.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.843+0000 7f0e23fb0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:10:05.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.843+0000 7f0e23fb0640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:10:05.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.843+0000 7f0e23fb0640 1 -- 10.20.193.104:0/1373227711 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0e1c0380f0 con 0x7f0e1c08ef90 2026-02-13T08:10:05.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.843+0000 7f0e0a7fc640 1 -- 10.20.193.104:0/1373227711 <== mon.1 v1:10.20.193.119:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1475 (unknown 254746657 0 2421318468) 0x7f0e10015a20 con 0x7f0e1c08ef90 2026-02-13T08:10:05.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.843+0000 7f0e0a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:10:05.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.843+0000 7f0e0a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:05.846 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:10:05.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 10 librados: watch_flush enter 2026-02-13T08:10:05.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 10 librados: watch_flush exit 2026-02-13T08:10:05.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 20 client.74410.objecter shutdown clearing up homeless session... 2026-02-13T08:10:05.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 10 client.74410.objecter successfully canceled tick 2026-02-13T08:10:05.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 1 -- 10.20.193.104:0/1373227711 >> v1:10.20.193.119:6812/276487904 conn(0x7f0dec03b9b0 legacy=0x7f0dec05be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 10 monclient: shutdown 2026-02-13T08:10:05.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:05.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 1 -- 10.20.193.104:0/1373227711 >> v1:10.20.193.119:6789/0 conn(0x7f0e1c08ef90 legacy=0x7f0e1c081480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.849 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 1 -- 10.20.193.104:0/1373227711 shutdown_connections 2026-02-13T08:10:05.849 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 1 -- 10.20.193.104:0/1373227711 >> 10.20.193.104:0/1373227711 conn(0x7f0e1c051e80 msgr2=0x7f0e1c18d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:05.849 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 1 -- 10.20.193.104:0/1373227711 shutdown_connections 2026-02-13T08:10:05.849 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 1 -- 10.20.193.104:0/1373227711 wait complete. 2026-02-13T08:10:05.849 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.847+0000 7f0e23fb0640 1 librados: shutdown 2026-02-13T08:10:05.856 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T08:10:05.856 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T08:10:05.857 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T08:10:05.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.915+0000 7fad2ea62640 10 monclient: get_monmap_and_config 2026-02-13T08:10:05.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.915+0000 7fad2ea62640 10 monclient: build_initial_monmap 2026-02-13T08:10:05.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.915+0000 7fad2ea62640 10 monclient: monmap: 2026-02-13T08:10:05.918 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:05.918 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.918 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:05.919785+0000 2026-02-13T08:10:05.918 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:05.919785+0000 2026-02-13T08:10:05.918 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:05.918 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.918 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:05.918 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:05.919 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:05.919 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 Processor -- start 2026-02-13T08:10:05.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- start start 2026-02-13T08:10:05.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: init 2026-02-13T08:10:05.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:05.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:10:05.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient(hunting): picked mon.noname-b con 0x7fad28091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:05.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient(hunting): picked mon.noname-a con 0x7fad2813f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient(hunting): picked mon.noname-c con 0x7fad2813fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2808e5f0 con 0x7fad2813f870 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2808e8d0 con 0x7fad2813fcd0 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2808ebb0 con 0x7fad28091740 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient(hunting): authenticate will time out at 711.508885s 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad27fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fad28091740 0x7fad2813f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47362/0 (socket says 10.20.193.104:47362) 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad27fff640 1 -- 10.20.193.104:0/37047372 learned_addr learned my addr 10.20.193.104:0/37047372 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 -- 10.20.193.104:0/37047372 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2226970559 0 0) 0x7fad2808e5f0 con 0x7fad2813f870 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:05.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient(hunting): my global_id is 84102 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 -- 10.20.193.104:0/37047372 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad0c003620 con 0x7fad2813f870 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 -- 10.20.193.104:0/37047372 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1202275106 0 0) 0x7fad2808ebb0 con 0x7fad28091740 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient(hunting): my global_id is 27527 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 -- 10.20.193.104:0/37047372 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad2808e5f0 con 0x7fad28091740 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 -- 10.20.193.104:0/37047372 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2628707298 0 0) 0x7fad0c003620 con 0x7fad2813f870 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 -- 10.20.193.104:0/37047372 >> v1:10.20.193.104:6790/0 conn(0x7fad28091740 legacy=0x7fad2813f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 -- 10.20.193.104:0/37047372 >> v1:10.20.193.119:6789/0 conn(0x7fad2813fcd0 legacy=0x7fad281a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 monclient: found mon.noname-a 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 -- 10.20.193.104:0/37047372 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad28091b10 con 0x7fad2813f870 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient: _finish_auth 0 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 -- 10.20.193.104:0/37047372 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fad18002e00 con 0x7fad2813f870 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient: dump: 2026-02-13T08:10:05.931 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 5 monclient: authenticate success, global_id 84102 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:05.932 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 -- 10.20.193.104:0/37047372 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad18003010 con 0x7fad2813f870 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 1 -- 10.20.193.104:0/37047372 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fad18003450 con 0x7fad2813f870 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad26ffd640 10 monclient: dump: 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:05.933 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 4 set_mon_vals no callback set 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: shutdown 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- 10.20.193.104:0/37047372 >> v1:10.20.193.104:6789/0 conn(0x7fad2813f870 legacy=0x7fad28180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- 10.20.193.104:0/37047372 shutdown_connections 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- 10.20.193.104:0/37047372 >> 10.20.193.104:0/37047372 conn(0x7fad28090810 msgr2=0x7fad28090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- 10.20.193.104:0/37047372 shutdown_connections 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- 10.20.193.104:0/37047372 wait complete. 2026-02-13T08:10:05.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: build_initial_monmap 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: monmap: 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 librados: starting msgr at 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 librados: starting objecter 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 Processor -- start 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- start start 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 librados: setting wanted keys 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 librados: calling monclient init 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: init 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient(hunting): picked mon.noname-c con 0x7fad28091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient(hunting): picked mon.noname-b con 0x7fad2813f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient(hunting): picked mon.noname-a con 0x7fad2813fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad2812de60 con 0x7fad2813fcd0 2026-02-13T08:10:05.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad28059370 con 0x7fad2813f870 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad281301c0 con 0x7fad28091740 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient(hunting): authenticate will time out at 711.511333s 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad27fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fad28091740 0x7fad2814fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47364/0 (socket says 10.20.193.104:47364) 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad27fff640 1 -- 10.20.193.104:0/3652727811 learned_addr learned my addr 10.20.193.104:0/3652727811 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 client.?.objecter ms_handle_connect 0x7fad28091740 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 client.?.objecter ms_handle_connect 0x7fad2813fcd0 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243161214 0 0) 0x7fad2812de60 con 0x7fad2813fcd0 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:05.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): my global_id is 84105 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf8003620 con 0x7fad2813fcd0 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459502367 0 0) 0x7fad281301c0 con 0x7fad28091740 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): my global_id is 27530 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad2812de60 con 0x7fad28091740 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 client.?.objecter ms_handle_connect 0x7fad2813f870 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3804495541 0 0) 0x7facf8003620 con 0x7fad2813fcd0 2026-02-13T08:10:05.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad281301c0 con 0x7fad2813fcd0 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fad1c0033a0 con 0x7fad2813fcd0 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): dump: 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:05.939 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 922422904 0 0) 0x7fad2812de60 con 0x7fad28091740 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7facf8003620 con 0x7fad28091740 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fad140030c0 con 0x7fad28091740 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): dump: 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.940 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399655806 0 0) 0x7fad28059370 con 0x7fad2813f870 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient(hunting): my global_id is 74416 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad2812de60 con 0x7fad2813f870 2026-02-13T08:10:05.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3094382875 0 0) 0x7fad281301c0 con 0x7fad2813fcd0 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 >> v1:10.20.193.104:6790/0 conn(0x7fad28091740 legacy=0x7fad2814fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 >> v1:10.20.193.119:6789/0 conn(0x7fad2813f870 legacy=0x7fad28190cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient: _finish_hunting 0 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 monclient: found mon.a 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2812e9c0 con 0x7fad2813fcd0 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient: _finish_auth 0 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient: _check_auth_tickets 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 5 monclient: authenticate success, global_id 84105 2026-02-13T08:10:05.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: _renew_subs 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fad2812d3b0 con 0x7fad2813fcd0 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 client.84105.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: _renew_subs 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fad28150330 con 0x7fad2813fcd0 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad2ea62640 1 librados: init done 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad1c003a00 con 0x7fad2813fcd0 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fad1c003e10 con 0x7fad2813fcd0 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:05.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad24ff9640 10 monclient: dump: 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.919+0000 7fad267fc640 4 set_mon_vals no callback set 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad2ea62640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad2ea62640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fad2812fd90 con 0x7fad280889c0 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 client.84105.objecter ms_handle_connect 0x7fad280889c0 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 client.84105.objecter resend_mon_ops 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435841676 0 0) 0x7fad2812fd90 con 0x7fad280889c0 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 monclient(hunting): my global_id is 84108 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad281301c0 con 0x7fad280889c0 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 204112727 0 0) 0x7fad281301c0 con 0x7fad280889c0 2026-02-13T08:10:05.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad2812fd90 con 0x7fad280889c0 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fad14004a80 con 0x7fad280889c0 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 monclient: dump: 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:05.946 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fad1c003fb0 con 0x7fad2813fcd0 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(209..209 src has 1..209) ==== 4739+0+0 (unknown 3756314505 0 0) 0x7fad1c0497a0 con 0x7fad2813fcd0 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 client.84105.objecter ms_dispatch2 0x7fad28000ba0 osd_map(209..209 src has 1..209) 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 3 client.84105.objecter handle_osd_map got epochs [209,209] > 0 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 3 client.84105.objecter handle_osd_map decoding full epoch 209 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 20 client.84105.objecter dump_active .. 0 homeless 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2844289068 0 0) 0x7fad2812fd90 con 0x7fad280889c0 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad2808ab30 con 0x7fad280889c0 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad277fe640 10 monclient: get_auth_request con 0x7facf803ba70 auth_method 0 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7fad14007830 con 0x7fad280889c0 2026-02-13T08:10:05.947 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 >> v1:10.20.193.104:6789/0 conn(0x7fad280889c0 legacy=0x7fad2804ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 >> v1:10.20.193.104:6789/0 conn(0x7fad280889c0 legacy=0x7fad2804ca00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.923+0000 7fad24ff9640 10 client.84105.objecter ms_handle_connect 0x7facf803ba70 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fad28058770 con 0x7fad28088d90 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 10 client.84105.objecter ms_handle_connect 0x7fad28088d90 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 10 client.84105.objecter resend_mon_ops 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1705847860 0 0) 0x7fad28058770 con 0x7fad28088d90 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:05.948 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 10 monclient(hunting): my global_id is 84111 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad2812fd90 con 0x7fad28088d90 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2606160825 0 0) 0x7fad2812fd90 con 0x7fad28088d90 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad28058770 con 0x7fad28088d90 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fad140055c0 con 0x7fad28088d90 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 10 monclient: dump: 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:05.949 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:05.950 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:05.950 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:05.950 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:05.950 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:05.950 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4178085975 0 0) 0x7fad28058770 con 0x7fad28088d90 2026-02-13T08:10:05.950 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 --> v1:10.20.193.104:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fad2812d790 con 0x7fad28088d90 2026-02-13T08:10:05.950 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4159 (unknown 0 0 175444767) 0x7fad140079e0 con 0x7fad28088d90 2026-02-13T08:10:05.950 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:10:05.950 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:05.950 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 >> v1:10.20.193.104:6789/0 conn(0x7fad28088d90 legacy=0x7fad28194b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.950 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad24ff9640 1 -- 10.20.193.104:0/3652727811 >> v1:10.20.193.104:6789/0 conn(0x7fad28088d90 legacy=0x7fad28194b40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:05.951 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:10:05.951 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:10:05.951 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:10:05.951 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:10:05.951 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 38, 2026-02-13T08:10:05.951 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 15260, 2026-02-13T08:10:05.951 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:10:05.951 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:10:05.951 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:10:05.951 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:05.952 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:05.953 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:10:05.954 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:05.955 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:05.956 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:10:05.957 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:05.958 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:10:05.959 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:05.960 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout: "num": 2 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:10:05.961 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 10 librados: watch_flush enter 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 10 librados: watch_flush exit 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 20 client.84105.objecter shutdown clearing up homeless session... 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 10 client.84105.objecter successfully canceled tick 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 1 -- 10.20.193.104:0/3652727811 >> v1:10.20.193.119:6812/276487904 conn(0x7facf803ba70 legacy=0x7facf805bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 10 monclient: shutdown 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 1 -- 10.20.193.104:0/3652727811 >> v1:10.20.193.104:6789/0 conn(0x7fad2813fcd0 legacy=0x7fad28192410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2cfd8640 1 -- 10.20.193.104:0/3652727811 reap_dead start 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2cfd8640 1 -- 10.20.193.104:0/3652727811 reap_dead start 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 1 -- 10.20.193.104:0/3652727811 shutdown_connections 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 1 -- 10.20.193.104:0/3652727811 >> 10.20.193.104:0/3652727811 conn(0x7fad28090810 msgr2=0x7fad2808c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:05.963 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 1 -- 10.20.193.104:0/3652727811 shutdown_connections 2026-02-13T08:10:05.964 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 1 -- 10.20.193.104:0/3652727811 wait complete. 2026-02-13T08:10:05.964 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:05.927+0000 7fad2ea62640 1 librados: shutdown 2026-02-13T08:10:05.964 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:10:05.964 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T08:10:05.964 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T08:10:06.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 10 monclient: get_monmap_and_config 2026-02-13T08:10:06.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 10 monclient: build_initial_monmap 2026-02-13T08:10:06.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 10 monclient: monmap: 2026-02-13T08:10:06.033 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:06.033 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.033 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:06.035202+0000 2026-02-13T08:10:06.033 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:06.035202+0000 2026-02-13T08:10:06.033 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:06.033 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.034 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:06.034 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:06.034 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:06.034 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.041 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 1 Processor -- start 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 1 -- start start 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 10 monclient: init 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 10 monclient(hunting): picked mon.noname-b con 0x7f620413f690 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 10 monclient(hunting): picked mon.noname-c con 0x7f620408d940 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 10 monclient(hunting): picked mon.noname-a con 0x7f620408dd60 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620408b890 con 0x7f620408dd60 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620408bb70 con 0x7f620408d940 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6204089f10 con 0x7f620413f690 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f620bf9a640 10 monclient(hunting): authenticate will time out at 711.623899s 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f6209d0f640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f620413f690 0x7f620408d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47368/0 (socket says 10.20.193.104:47368) 2026-02-13T08:10:06.042 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.031+0000 7f6209d0f640 1 -- 10.20.193.104:0/2892279318 learned_addr learned my addr 10.20.193.104:0/2892279318 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 -- 10.20.193.104:0/2892279318 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3951447426 0 0) 0x7f620408b890 con 0x7f620408dd60 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient(hunting): my global_id is 84114 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 -- 10.20.193.104:0/2892279318 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61ec003620 con 0x7f620408dd60 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 -- 10.20.193.104:0/2892279318 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679465410 0 0) 0x7f6204089f10 con 0x7f620413f690 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient(hunting): my global_id is 27533 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 -- 10.20.193.104:0/2892279318 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f620408b890 con 0x7f620413f690 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 -- 10.20.193.104:0/2892279318 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1447839143 0 0) 0x7f61ec003620 con 0x7f620408dd60 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 -- 10.20.193.104:0/2892279318 >> v1:10.20.193.104:6790/0 conn(0x7f620413f690 legacy=0x7f620408d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.043 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 -- 10.20.193.104:0/2892279318 >> v1:10.20.193.119:6789/0 conn(0x7f620408d940 legacy=0x7f6204180540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient: _finish_hunting 0 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 monclient: found mon.noname-a 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 -- 10.20.193.104:0/2892279318 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62041a63c0 con 0x7f620408dd60 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient: _finish_auth 0 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient: _check_auth_tickets 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 -- 10.20.193.104:0/2892279318 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6200003180 con 0x7f620408dd60 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient: dump: 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.044 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 5 monclient: authenticate success, global_id 84114 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 -- 10.20.193.104:0/2892279318 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6200003400 con 0x7f620408dd60 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 1 -- 10.20.193.104:0/2892279318 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6200003840 con 0x7f620408dd60 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6208d0d640 10 monclient: dump: 2026-02-13T08:10:06.045 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 4 set_mon_vals no callback set 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient: shutdown 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- 10.20.193.104:0/2892279318 >> v1:10.20.193.104:6789/0 conn(0x7f620408dd60 legacy=0x7f62041a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- 10.20.193.104:0/2892279318 shutdown_connections 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- 10.20.193.104:0/2892279318 >> 10.20.193.104:0/2892279318 conn(0x7f6204051a50 msgr2=0x7f6204051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- 10.20.193.104:0/2892279318 shutdown_connections 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- 10.20.193.104:0/2892279318 wait complete. 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient: build_initial_monmap 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient: monmap: 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 librados: starting msgr at 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 librados: starting objecter 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 Processor -- start 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- start start 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 librados: setting wanted keys 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 librados: calling monclient init 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient: init 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient(hunting): picked mon.noname-c con 0x7f620408d940 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient(hunting): picked mon.noname-b con 0x7f620408dd60 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient(hunting): picked mon.noname-a con 0x7f620413f690 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620405b5f0 con 0x7f620413f690 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620413cec0 con 0x7f620408dd60 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62041a5f20 con 0x7f620408d940 2026-02-13T08:10:06.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient(hunting): authenticate will time out at 711.625720s 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6209d0f640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f620408d940 0x7f6204057b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47378/0 (socket says 10.20.193.104:47378) 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f6209d0f640 1 -- 10.20.193.104:0/1323862597 learned_addr learned my addr 10.20.193.104:0/1323862597 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 client.?.objecter ms_handle_connect 0x7f620408d940 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 client.?.objecter ms_handle_connect 0x7f620413f690 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790352337 0 0) 0x7f62041a5f20 con 0x7f620408d940 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): my global_id is 27536 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61d4003620 con 0x7f620408d940 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2758106190 0 0) 0x7f620405b5f0 con 0x7f620413f690 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): my global_id is 84117 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62041a5f20 con 0x7f620413f690 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 client.?.objecter ms_handle_connect 0x7f620408dd60 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4067460939 0 0) 0x7f61d4003620 con 0x7f620408d940 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f620405b5f0 con 0x7f620408d940 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f61f4003100 con 0x7f620408d940 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): dump: 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.050 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 609551907 0 0) 0x7f62041a5f20 con 0x7f620413f690 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61d4003620 con 0x7f620413f690 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6200003090 con 0x7f620413f690 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): dump: 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.051 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2671490983 0 0) 0x7f620413cec0 con 0x7f620408dd60 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): my global_id is 74419 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62041a5f20 con 0x7f620408dd60 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3200489655 0 0) 0x7f620405b5f0 con 0x7f620408d940 2026-02-13T08:10:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 >> v1:10.20.193.119:6789/0 conn(0x7f620408dd60 legacy=0x7f6204058220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 >> v1:10.20.193.104:6789/0 conn(0x7f620413f690 legacy=0x7f6204193670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: _finish_hunting 0 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 monclient: found mon.c 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6204086620 con 0x7f620408d940 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: _finish_auth 0 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: _check_auth_tickets 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 5 monclient: authenticate success, global_id 27536 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient: _renew_subs 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f620405b030 con 0x7f620408d940 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 client.27536.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient: _renew_subs 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f620405ba10 con 0x7f620408d940 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 librados: init done 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61f40048e0 con 0x7f620408d940 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f61f4004c30 con 0x7f620408d940 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: dump: 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.054 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f3fff640 4 set_mon_vals no callback set 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620bf9a640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62041a5c50 con 0x7f62041a35a0 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 client.27536.objecter ms_handle_connect 0x7f62041a35a0 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 client.27536.objecter resend_mon_ops 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f61f4010c40 con 0x7f620408d940 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(209..209 src has 1..209) ==== 4739+0+0 (unknown 3756314505 0 0) 0x7f61f404a6d0 con 0x7f620408d940 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 client.27536.objecter ms_dispatch2 0x7f6204000ba0 osd_map(209..209 src has 1..209) 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 3 client.27536.objecter handle_osd_map got epochs [209,209] > 0 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 3 client.27536.objecter handle_osd_map decoding full epoch 209 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 20 client.27536.objecter dump_active .. 0 homeless 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 889998263 0 0) 0x7f62041a5c50 con 0x7f62041a35a0 2026-02-13T08:10:06.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient(hunting): my global_id is 27539 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f620405b5f0 con 0x7f62041a35a0 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2547061018 0 0) 0x7f620405b5f0 con 0x7f62041a35a0 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62041a5c50 con 0x7f62041a35a0 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f61f8002c60 con 0x7f62041a35a0 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: dump: 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.056 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f620a510640 10 monclient: get_auth_request con 0x7f61d403ba10 auth_method 0 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1247999641 0 0) 0x7f62041a5c50 con 0x7f62041a35a0 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6204061860 con 0x7f62041a35a0 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 client.27536.objecter ms_handle_connect 0x7f61d403ba10 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f61f80049b0 con 0x7f62041a35a0 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 >> v1:10.20.193.104:6790/0 conn(0x7f62041a35a0 legacy=0x7f62040867f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.035+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 >> v1:10.20.193.104:6790/0 conn(0x7f62041a35a0 legacy=0x7f62040867f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620bf9a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620bf9a640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6204058aa0 con 0x7f6204086f00 2026-02-13T08:10:06.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 10 client.27536.objecter ms_handle_connect 0x7f6204086f00 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 10 client.27536.objecter resend_mon_ops 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868149708 0 0) 0x7f6204058aa0 con 0x7f6204086f00 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 10 monclient(hunting): my global_id is 27542 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62041a5c50 con 0x7f6204086f00 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3926427988 0 0) 0x7f62041a5c50 con 0x7f6204086f00 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6204058aa0 con 0x7f6204086f00 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f61f8003270 con 0x7f6204086f00 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 10 monclient: dump: 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.058 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3854340950 0 0) 0x7f6204058aa0 con 0x7f6204086f00 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 --> v1:10.20.193.104:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6204058c70 con 0x7f6204086f00 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4492 (unknown 0 0 3721928808) 0x7f61f8003130 con 0x7f6204086f00 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 >> v1:10.20.193.104:6790/0 conn(0x7f6204086f00 legacy=0x7f6204195da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f61f27fc640 1 -- 10.20.193.104:0/1323862597 >> v1:10.20.193.104:6790/0 conn(0x7f6204086f00 legacy=0x7f6204195da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:06.060 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:10:06.060 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:10:06.060 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:10:06.060 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:10:06.060 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 38, 2026-02-13T08:10:06.060 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 275446, 2026-02-13T08:10:06.060 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:10:06.060 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:10:06.060 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:10:06.060 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:06.061 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:06.062 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:06.063 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:06.064 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.065 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:06.066 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:06.067 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.068 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: "num": 4 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:06.069 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:10:06.070 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.070 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:06.070 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:06.070 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:06.070 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.070 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.070 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.070 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:10:06.070 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:10:06.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620bf9a640 10 librados: watch_flush enter 2026-02-13T08:10:06.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620bf9a640 10 librados: watch_flush exit 2026-02-13T08:10:06.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620bf9a640 20 client.27536.objecter shutdown clearing up homeless session... 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620bf9a640 10 client.27536.objecter successfully canceled tick 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620bf9a640 1 -- 10.20.193.104:0/1323862597 >> v1:10.20.193.119:6812/276487904 conn(0x7f61d403ba10 legacy=0x7f61d405bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620bf9a640 10 monclient: shutdown 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620bf9a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620bf9a640 1 -- 10.20.193.104:0/1323862597 >> v1:10.20.193.104:6790/0 conn(0x7f620408d940 legacy=0x7f6204057b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620a510640 1 -- 10.20.193.104:0/1323862597 reap_dead start 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.039+0000 7f620a510640 1 -- 10.20.193.104:0/1323862597 reap_dead start 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.043+0000 7f620bf9a640 1 -- 10.20.193.104:0/1323862597 shutdown_connections 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.043+0000 7f620bf9a640 1 -- 10.20.193.104:0/1323862597 >> 10.20.193.104:0/1323862597 conn(0x7f6204051a50 msgr2=0x7f620405ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.043+0000 7f620bf9a640 1 -- 10.20.193.104:0/1323862597 shutdown_connections 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.043+0000 7f620bf9a640 1 -- 10.20.193.104:0/1323862597 wait complete. 2026-02-13T08:10:06.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.043+0000 7f620bf9a640 1 librados: shutdown 2026-02-13T08:10:06.072 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:10:06.072 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T08:10:06.073 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T08:10:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.139+0000 7f664fa5d640 10 monclient: get_monmap_and_config 2026-02-13T08:10:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.139+0000 7f664fa5d640 10 monclient: build_initial_monmap 2026-02-13T08:10:06.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.139+0000 7f664fa5d640 10 monclient: monmap: 2026-02-13T08:10:06.142 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:06.142 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.142 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:06.143744+0000 2026-02-13T08:10:06.142 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:06.143744+0000 2026-02-13T08:10:06.142 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:06.142 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.142 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:06.142 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:06.142 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:06.142 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 Processor -- start 2026-02-13T08:10:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- start start 2026-02-13T08:10:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: init 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient(hunting): picked mon.noname-c con 0x7f6648091740 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient(hunting): picked mon.noname-b con 0x7f664813f870 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient(hunting): picked mon.noname-a con 0x7f664813fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664808e5f0 con 0x7f664813fcd0 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664808e8d0 con 0x7f6648091740 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664808ebb0 con 0x7f664813f870 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient(hunting): authenticate will time out at 711.732561s 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664cfd1640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f664813f870 0x7f6648180690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47420/0 (socket says 10.20.193.104:47420) 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664cfd1640 1 -- 10.20.193.104:0/3095608636 learned_addr learned my addr 10.20.193.104:0/3095608636 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815704548 0 0) 0x7f664808ebb0 con 0x7f664813f870 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): my global_id is 27545 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6630003620 con 0x7f664813f870 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4141074736 0 0) 0x7f664808e5f0 con 0x7f664813fcd0 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): my global_id is 84120 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f664808ebb0 con 0x7f664813fcd0 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2378983178 0 0) 0x7f664808e8d0 con 0x7f6648091740 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient(hunting): my global_id is 74422 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f664808e5f0 con 0x7f6648091740 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2508355057 0 0) 0x7f6630003620 con 0x7f664813f870 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 >> v1:10.20.193.119:6789/0 conn(0x7f6648091740 legacy=0x7f664813f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 >> v1:10.20.193.104:6789/0 conn(0x7f664813fcd0 legacy=0x7f66481a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient: _finish_hunting 0 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 monclient: found mon.noname-b 2026-02-13T08:10:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6648091b10 con 0x7f664813f870 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient: _finish_auth 0 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient: _check_auth_tickets 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 5 monclient: authenticate success, global_id 27545 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f663c002cf0 con 0x7f664813f870 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient: dump: 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.151 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f663c002f80 con 0x7f664813f870 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 1 -- 10.20.193.104:0/3095608636 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f663c003350 con 0x7f664813f870 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6637fff640 10 monclient: dump: 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.152 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 4 set_mon_vals no callback set 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: shutdown 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- 10.20.193.104:0/3095608636 >> v1:10.20.193.104:6790/0 conn(0x7f664813f870 legacy=0x7f6648180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- 10.20.193.104:0/3095608636 shutdown_connections 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- 10.20.193.104:0/3095608636 >> 10.20.193.104:0/3095608636 conn(0x7f6648090810 msgr2=0x7f6648090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- 10.20.193.104:0/3095608636 shutdown_connections 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- 10.20.193.104:0/3095608636 wait complete. 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: build_initial_monmap 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: monmap: 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:06.153 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 librados: starting msgr at 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 librados: starting objecter 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 Processor -- start 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- start start 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 librados: setting wanted keys 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 librados: calling monclient init 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: init 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient(hunting): picked mon.noname-a con 0x7f6648091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient(hunting): picked mon.noname-b con 0x7f664813f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient(hunting): picked mon.noname-c con 0x7f664813fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66480587e0 con 0x7f6648091740 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664812fe80 con 0x7f664813f870 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f664808ab30 con 0x7f664813fcd0 2026-02-13T08:10:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient(hunting): authenticate will time out at 711.734727s 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664d7d2640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f6648091740 0x7f664814f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:50276/0 (socket says 10.20.193.104:50276) 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664d7d2640 1 -- 10.20.193.104:0/2755858667 learned_addr learned my addr 10.20.193.104:0/2755858667 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 client.?.objecter ms_handle_connect 0x7f6648091740 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 client.?.objecter ms_handle_connect 0x7f664813fcd0 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2091983831 0 0) 0x7f664808ab30 con 0x7f664813fcd0 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): my global_id is 27548 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6618003620 con 0x7f664813fcd0 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2922264634 0 0) 0x7f66480587e0 con 0x7f6648091740 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): my global_id is 84123 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f664808ab30 con 0x7f6648091740 2026-02-13T08:10:06.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1303880887 0 0) 0x7f6618003620 con 0x7f664813fcd0 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66480587e0 con 0x7f664813fcd0 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 client.?.objecter ms_handle_connect 0x7f664813f870 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6644003430 con 0x7f664813fcd0 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): dump: 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:06.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4124337118 0 0) 0x7f664808ab30 con 0x7f6648091740 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6618003620 con 0x7f6648091740 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6638003100 con 0x7f6648091740 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient(hunting): dump: 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4188045005 0 0) 0x7f66480587e0 con 0x7f664813fcd0 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 >> v1:10.20.193.119:6789/0 conn(0x7f664813f870 legacy=0x7f66481909c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 >> v1:10.20.193.104:6789/0 conn(0x7f6648091740 legacy=0x7f664814f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:10:06.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 monclient: found mon.c 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f664813f440 con 0x7f664813fcd0 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient: _finish_auth 0 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 5 monclient: authenticate success, global_id 27548 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: _renew_subs 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f664812db20 con 0x7f664813fcd0 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 client.27548.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: _renew_subs 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f664812e680 con 0x7f664813fcd0 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 librados: init done 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6644003880 con 0x7f664813fcd0 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6644003c10 con 0x7f664813fcd0 2026-02-13T08:10:06.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f66377fe640 4 set_mon_vals no callback set 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 10 monclient: dump: 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f664fa5d640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f664812d440 con 0x7f664812d070 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.143+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f6644003db0 con 0x7f664813fcd0 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 client.27548.objecter ms_handle_connect 0x7f664812d070 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 client.27548.objecter resend_mon_ops 2026-02-13T08:10:06.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(209..209 src has 1..209) ==== 4739+0+0 (unknown 3756314505 0 0) 0x7f66440497f0 con 0x7f664813fcd0 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 client.27548.objecter ms_dispatch2 0x7f6648000ba0 osd_map(209..209 src has 1..209) 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 3 client.27548.objecter handle_osd_map got epochs [209,209] > 0 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 3 client.27548.objecter handle_osd_map decoding full epoch 209 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 20 client.27548.objecter dump_active .. 0 homeless 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1079976629 0 0) 0x7f664812d440 con 0x7f664812d070 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 monclient(hunting): my global_id is 74428 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66480587e0 con 0x7f664812d070 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f664cfd1640 10 monclient: get_auth_request con 0x7f661803b850 auth_method 0 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1272584464 0 0) 0x7f66480587e0 con 0x7f664812d070 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f664812d440 con 0x7f664812d070 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 client.27548.objecter ms_handle_connect 0x7f661803b850 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f66380038c0 con 0x7f664812d070 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 monclient: dump: 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.160 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1811732236 0 0) 0x7f664812d440 con 0x7f664812d070 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.119:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6648061860 con 0x7f664812d070 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f66380038f0 con 0x7f664812d070 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 >> v1:10.20.193.119:6789/0 conn(0x7f664812d070 legacy=0x7f6648088990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.147+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 >> v1:10.20.193.119:6789/0 conn(0x7f664812d070 legacy=0x7f6648088990 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:06.162 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:10:06.162 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f664804d110 con 0x7f66481502a0 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 10 client.27548.objecter ms_handle_connect 0x7f66481502a0 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 10 client.27548.objecter resend_mon_ops 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273052209 0 0) 0x7f664804d110 con 0x7f66481502a0 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 10 monclient(hunting): my global_id is 74431 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f664812d440 con 0x7f66481502a0 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3541669927 0 0) 0x7f664812d440 con 0x7f66481502a0 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f664804d110 con 0x7f66481502a0 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6638003f80 con 0x7f66481502a0 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 10 monclient: dump: 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.163 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3933142853 0 0) 0x7f664804d110 con 0x7f66481502a0 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 --> v1:10.20.193.119:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f66481979b0 con 0x7f66481502a0 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4325 (unknown 0 0 3712006948) 0x7f6638003ff0 con 0x7f66481502a0 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 >> v1:10.20.193.119:6789/0 conn(0x7f66481502a0 legacy=0x7f664804ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f6635ffb640 1 -- 10.20.193.104:0/2755858667 >> v1:10.20.193.119:6789/0 conn(0x7f66481502a0 legacy=0x7f664804ca00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:10:06.164 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 38, 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 143168, 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:06.165 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:06.166 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:10:06.167 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:06.168 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:10:06.169 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:06.170 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:06.171 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:06.172 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:10:06.173 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:06.173 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:06.173 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:06.173 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:10:06.173 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:06.173 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:06.173 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:06.173 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:10:06.173 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:10:06.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 10 librados: watch_flush enter 2026-02-13T08:10:06.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 10 librados: watch_flush exit 2026-02-13T08:10:06.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 20 client.27548.objecter shutdown clearing up homeless session... 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 10 client.27548.objecter successfully canceled tick 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 1 -- 10.20.193.104:0/2755858667 >> v1:10.20.193.119:6812/276487904 conn(0x7f661803b850 legacy=0x7f661805bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 10 monclient: shutdown 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 1 -- 10.20.193.104:0/2755858667 >> v1:10.20.193.104:6790/0 conn(0x7f664813fcd0 legacy=0x7f66481920e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664dfd3640 1 -- 10.20.193.104:0/2755858667 reap_dead start 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664dfd3640 1 -- 10.20.193.104:0/2755858667 reap_dead start 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 1 -- 10.20.193.104:0/2755858667 shutdown_connections 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 1 -- 10.20.193.104:0/2755858667 >> 10.20.193.104:0/2755858667 conn(0x7f6648090810 msgr2=0x7f6648057f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 1 -- 10.20.193.104:0/2755858667 shutdown_connections 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 1 -- 10.20.193.104:0/2755858667 wait complete. 2026-02-13T08:10:06.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.151+0000 7f664fa5d640 1 librados: shutdown 2026-02-13T08:10:06.175 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:10:06.175 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T08:10:06.176 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T08:10:06.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.239+0000 7f093e38a640 10 monclient: get_monmap_and_config 2026-02-13T08:10:06.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.239+0000 7f093e38a640 10 monclient: build_initial_monmap 2026-02-13T08:10:06.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.239+0000 7f093e38a640 10 monclient: monmap: 2026-02-13T08:10:06.241 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:06.242 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.242 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:06.243718+0000 2026-02-13T08:10:06.242 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:06.243718+0000 2026-02-13T08:10:06.242 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:06.242 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.242 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:06.242 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:06.242 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:06.242 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 Processor -- start 2026-02-13T08:10:06.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- start start 2026-02-13T08:10:06.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: init 2026-02-13T08:10:06.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient(hunting): picked mon.noname-a con 0x7f093808e4b0 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient(hunting): picked mon.noname-b con 0x7f093808ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient(hunting): picked mon.noname-c con 0x7f093817fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0938089fa0 con 0x7f093808e4b0 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0938089760 con 0x7f093817fe50 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f093808af90 con 0x7f093808ef90 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient(hunting): authenticate will time out at 711.832382s 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0937fff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f093808e4b0 0x7f093808e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:50292/0 (socket says 10.20.193.104:50292) 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0937fff640 1 -- 10.20.193.104:0/1232269667 learned_addr learned my addr 10.20.193.104:0/1232269667 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 -- 10.20.193.104:0/1232269667 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019448956 0 0) 0x7f093808af90 con 0x7f093808ef90 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient(hunting): my global_id is 27551 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 -- 10.20.193.104:0/1232269667 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f091c003620 con 0x7f093808ef90 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 -- 10.20.193.104:0/1232269667 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862729222 0 0) 0x7f0938089fa0 con 0x7f093808e4b0 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient(hunting): my global_id is 84126 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 -- 10.20.193.104:0/1232269667 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f093808af90 con 0x7f093808e4b0 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 -- 10.20.193.104:0/1232269667 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 392470119 0 0) 0x7f091c003620 con 0x7f093808ef90 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 -- 10.20.193.104:0/1232269667 >> v1:10.20.193.119:6789/0 conn(0x7f093817fe50 legacy=0x7f09381a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 -- 10.20.193.104:0/1232269667 >> v1:10.20.193.104:6789/0 conn(0x7f093808e4b0 legacy=0x7f093808e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 monclient: found mon.noname-b 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 -- 10.20.193.104:0/1232269667 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093808b270 con 0x7f093808ef90 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient: _finish_auth 0 2026-02-13T08:10:06.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 -- 10.20.193.104:0/1232269667 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0928002e00 con 0x7f093808ef90 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient: dump: 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 5 monclient: authenticate success, global_id 27551 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:06.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 -- 10.20.193.104:0/1232269667 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09280030c0 con 0x7f093808ef90 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 1 -- 10.20.193.104:0/1232269667 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0928003500 con 0x7f093808ef90 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0936ffd640 10 monclient: dump: 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:06.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 4 set_mon_vals no callback set 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: shutdown 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- 10.20.193.104:0/1232269667 >> v1:10.20.193.104:6790/0 conn(0x7f093808ef90 legacy=0x7f093817e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- 10.20.193.104:0/1232269667 shutdown_connections 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- 10.20.193.104:0/1232269667 >> 10.20.193.104:0/1232269667 conn(0x7f0938051e80 msgr2=0x7f093808c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- 10.20.193.104:0/1232269667 shutdown_connections 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- 10.20.193.104:0/1232269667 wait complete. 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: build_initial_monmap 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: monmap: 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:06.252 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 librados: starting msgr at 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 librados: starting objecter 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 Processor -- start 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- start start 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 librados: setting wanted keys 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 librados: calling monclient init 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: init 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient(hunting): picked mon.noname-c con 0x7f093808e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient(hunting): picked mon.noname-a con 0x7f093808ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient(hunting): picked mon.noname-b con 0x7f093817fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f093807d310 con 0x7f093808ef90 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f093807e840 con 0x7f093817fe50 2026-02-13T08:10:06.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0938086790 con 0x7f093808e4b0 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient(hunting): authenticate will time out at 711.834651s 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0937fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f093808e4b0 0x7f0938084dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47450/0 (socket says 10.20.193.104:47450) 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0937fff640 1 -- 10.20.193.104:0/81175491 learned_addr learned my addr 10.20.193.104:0/81175491 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 client.?.objecter ms_handle_connect 0x7f093808e4b0 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 client.?.objecter ms_handle_connect 0x7f093808ef90 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656237155 0 0) 0x7f0938086790 con 0x7f093808e4b0 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): my global_id is 27554 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0908003620 con 0x7f093808e4b0 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168172905 0 0) 0x7f093807d310 con 0x7f093808ef90 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:06.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): my global_id is 84129 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0938086790 con 0x7f093808ef90 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3390933399 0 0) 0x7f0908003620 con 0x7f093808e4b0 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f093807d310 con 0x7f093808e4b0 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0924003150 con 0x7f093808e4b0 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): dump: 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.255 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2932823407 0 0) 0x7f0938086790 con 0x7f093808ef90 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0908003620 con 0x7f093808ef90 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3281294658 0 0) 0x7f093807d310 con 0x7f093808e4b0 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 >> v1:10.20.193.119:6789/0 conn(0x7f093817fe50 legacy=0x7f093816e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 >> v1:10.20.193.104:6789/0 conn(0x7f093808ef90 legacy=0x7f093816d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient: _finish_hunting 0 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 monclient: found mon.c 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093807bf10 con 0x7f093808e4b0 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient: _finish_auth 0 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient: _check_auth_tickets 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 client.?.objecter ms_handle_connect 0x7f093817fe50 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:06.256 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 5 monclient: authenticate success, global_id 27554 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: _renew_subs 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- 10.20.193.104:0/81175491 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0938059fa0 con 0x7f093808e4b0 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 client.27554.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: _renew_subs 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- 10.20.193.104:0/81175491 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f093807d040 con 0x7f093808e4b0 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 librados: init done 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0924003480 con 0x7f093808e4b0 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0924004d30 con 0x7f093808e4b0 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f09367fc640 4 set_mon_vals no callback set 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 monclient: dump: 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:06.257 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f093e38a640 1 -- 10.20.193.104:0/81175491 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f093805c8c0 con 0x7f093808e4b0 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f0924010d40 con 0x7f093808e4b0 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(209..209 src has 1..209) ==== 4739+0+0 (unknown 3756314505 0 0) 0x7f092404a6d0 con 0x7f093808e4b0 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 10 client.27554.objecter ms_dispatch2 0x7f0938000ba0 osd_map(209..209 src has 1..209) 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 3 client.27554.objecter handle_osd_map got epochs [209,209] > 0 2026-02-13T08:10:06.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.243+0000 7f0934ff9640 3 client.27554.objecter handle_osd_map decoding full epoch 209 2026-02-13T08:10:06.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.247+0000 7f0934ff9640 20 client.27554.objecter dump_active .. 0 homeless 2026-02-13T08:10:06.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.247+0000 7f09377fe640 10 monclient: get_auth_request con 0x7f090803b7c0 auth_method 0 2026-02-13T08:10:06.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.247+0000 7f0934ff9640 10 client.27554.objecter ms_handle_connect 0x7f090803b7c0 2026-02-13T08:10:06.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.247+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f0924016c10 con 0x7f093808e4b0 2026-02-13T08:10:06.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.247+0000 7f0934ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:06.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.247+0000 7f0934ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:06.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.363+0000 7f093e38a640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T08:10:06.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.363+0000 7f093e38a640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T08:10:06.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.363+0000 7f093e38a640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:06.365 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.363+0000 7f093e38a640 1 -- 10.20.193.104:0/81175491 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f09380380f0 con 0x7f093808e4b0 2026-02-13T08:10:06.366 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.366 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=3257115358,config=3140514009,health=1881428993,kv=1902577111,logm=2505883072}) 2026-02-13T08:10:06.366 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=14,config=2,health=13,kv=10,logm=61} crc {auth=1329139757,config=3140514009,health=1181117202,kv=1692168360,logm=938109470}) 2026-02-13T08:10:06.366 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f0934ff9640 1 -- 10.20.193.104:0/81175491 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f0924016510 con 0x7f093808e4b0 2026-02-13T08:10:06.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f0934ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T08:10:06.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f0934ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:06.368 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=10,logm=62} crc {auth=3257115358,config=3140514009,health=1881428993,kv=1902577111,logm=2505883072}) 2026-02-13T08:10:06.368 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=14,config=2,health=11,kv=10,logm=63} crc {auth=3261962631,config=3140514009,health=3265816859,kv=1692168360,logm=936966836}) 2026-02-13T08:10:06.368 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.368 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2817676317}) 2026-02-13T08:10:06.368 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1307774618}) 2026-02-13T08:10:06.368 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.368 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2817676317}) 2026-02-13T08:10:06.368 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4169531438}) 2026-02-13T08:10:06.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 10 librados: watch_flush enter 2026-02-13T08:10:06.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 10 librados: watch_flush exit 2026-02-13T08:10:06.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 20 client.27554.objecter shutdown clearing up homeless session... 2026-02-13T08:10:06.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 10 client.27554.objecter successfully canceled tick 2026-02-13T08:10:06.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 1 -- 10.20.193.104:0/81175491 >> v1:10.20.193.119:6812/276487904 conn(0x7f090803b7c0 legacy=0x7f090805bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 10 monclient: shutdown 2026-02-13T08:10:06.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:06.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 1 -- 10.20.193.104:0/81175491 >> v1:10.20.193.104:6790/0 conn(0x7f093808e4b0 legacy=0x7f0938084dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:06.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 1 -- 10.20.193.104:0/81175491 shutdown_connections 2026-02-13T08:10:06.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 1 -- 10.20.193.104:0/81175491 >> 10.20.193.104:0/81175491 conn(0x7f0938051e80 msgr2=0x7f0938059320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:06.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 1 -- 10.20.193.104:0/81175491 shutdown_connections 2026-02-13T08:10:06.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 1 -- 10.20.193.104:0/81175491 wait complete. 2026-02-13T08:10:06.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:06.367+0000 7f093e38a640 1 librados: shutdown 2026-02-13T08:10:06.376 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.376 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3401726974}) 2026-02-13T08:10:06.376 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1849228701}) 2026-02-13T08:10:06.376 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.376 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3401726974}) 2026-02-13T08:10:06.376 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3396531508}) 2026-02-13T08:10:06.376 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3370138746}) 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1215349645}) 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3370138746}) 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4134922785}) 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2683731727}) 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=955537868}) 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2683731727}) 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2365182177}) 2026-02-13T08:10:06.377 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=709264909}) 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1005945937}) 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=709264909}) 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1484852034}) 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125624309}) 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2410387887}) 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2125624309}) 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.367+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1156310088}) 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=679817099}) 2026-02-13T08:10:06.378 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3300855211}) 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=679817099}) 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=554420832}) 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20714156}) 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3753423668}) 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20714156}) 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3698802761}) 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189351739}) 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=399805267}) 2026-02-13T08:10:06.379 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2189351739}) 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4190350257}) 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=270331452}) 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2602028121}) 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=270331452}) 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=82257418}) 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1854506481}) 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=44980272}) 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.380 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1854506481}) 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2431535134}) 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451545974}) 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=810934222}) 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451545974}) 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3005711857}) 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1601305748}) 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1923272347}) 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.381 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1601305748}) 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.371+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3403878505}) 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243467471}) 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=803602447}) 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243467471}) 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3095815180}) 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3787878072}) 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3322624749}) 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3787878072}) 2026-02-13T08:10:06.382 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=589961946}) 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1061160893}) 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2071976065}) 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1061160893}) 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=795743749}) 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3773772801}) 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1798309301}) 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3773772801}) 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1528869522}) 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.383 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238729376}) 2026-02-13T08:10:06.384 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4106125292}) 2026-02-13T08:10:06.384 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.384 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238729376}) 2026-02-13T08:10:06.384 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=213691222}) 2026-02-13T08:10:06.385 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T08:10:06.388 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.389 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2617333812}) 2026-02-13T08:10:06.389 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3404770879}) 2026-02-13T08:10:06.389 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.389 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2617333812}) 2026-02-13T08:10:06.389 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=324168887}) 2026-02-13T08:10:06.389 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.389 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2453995815}) 2026-02-13T08:10:06.389 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4230790373}) 2026-02-13T08:10:06.389 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.389 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2453995815}) 2026-02-13T08:10:06.389 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3907927194}) 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1209155508}) 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3646061949}) 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1209155508}) 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.375+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3843092205}) 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=11653725}) 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=543714189}) 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=11653725}) 2026-02-13T08:10:06.390 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=103186127}) 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278329416}) 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3475647168}) 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278329416}) 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1121359101}) 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=17,osdmap=11} crc {logm=1091483523,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=3654207298,mon_config_key=77698472,monmap=3655561526,nvmeofgw=3140514009,osd_metadata=2315316943,osd_pg_creating=1716956221,osd_snap=1478898058,osdmap=209868780}) 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=28,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=17,osdmap=15} crc {logm=253769990,mdsmap=2858549010,mgr=2473203893,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=1343107740,mon_config_key=4286042592,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=3283767234,osd_pg_creating=1716956221,osd_snap=1478898058,osdmap=429299388}) 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=17,osdmap=11} crc {logm=1091483523,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=3654207298,mon_config_key=77698472,monmap=3655561526,nvmeofgw=3140514009,osd_metadata=2315316943,osd_pg_creating=1716956221,osd_snap=1478898058,osdmap=209868780}) 2026-02-13T08:10:06.391 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=29,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=17,osdmap=13} crc {logm=4283017314,mdsmap=2858549010,mgr=2249387161,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=2509771093,mon_config_key=1358190956,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=2315316943,osd_pg_creating=1716956221,osd_snap=1478898058,osdmap=3671747916}) 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3525165085}) 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1368454056}) 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3525165085}) 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4153844775}) 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=689567120}) 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4086804941}) 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=689567120}) 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=226363102}) 2026-02-13T08:10:06.392 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.393 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2405576306}) 2026-02-13T08:10:06.393 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=986074634}) 2026-02-13T08:10:06.393 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.393 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2405576306}) 2026-02-13T08:10:06.393 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3543247949}) 2026-02-13T08:10:06.393 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.393 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=8} crc {osdmap=725506933}) 2026-02-13T08:10:06.393 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=10} crc {osdmap=1531971090}) 2026-02-13T08:10:06.393 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:10:06.393 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=8} crc {osdmap=725506933}) 2026-02-13T08:10:06.393 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:10:06.379+0000 7fbdd8c88640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=7} crc {osdmap=1791156412}) 2026-02-13T08:10:07.386 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T08:10:07.386 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:10:07.456 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient: get_monmap_and_config 2026-02-13T08:10:07.456 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient: build_initial_monmap 2026-02-13T08:10:07.456 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient: monmap: 2026-02-13T08:10:07.456 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:07.456 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.457 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:07.458411+0000 2026-02-13T08:10:07.457 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:07.458411+0000 2026-02-13T08:10:07.457 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:07.457 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.457 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:07.457 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:07.457 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:07.457 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 1 Processor -- start 2026-02-13T08:10:07.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 1 -- start start 2026-02-13T08:10:07.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient: init 2026-02-13T08:10:07.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:07.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient(hunting): picked mon.noname-a con 0x7ff64008e4b0 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient(hunting): picked mon.noname-b con 0x7ff64008ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient(hunting): picked mon.noname-c con 0x7ff64017fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff640089fa0 con 0x7ff64008e4b0 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff640089760 con 0x7ff64017fe50 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64008af90 con 0x7ff64008ef90 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient(hunting): authenticate will time out at 713.047276s 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63ffff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7ff64008e4b0 0x7ff64008e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:50310/0 (socket says 10.20.193.104:50310) 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63ffff640 1 -- 10.20.193.104:0/2172578940 learned_addr learned my addr 10.20.193.104:0/2172578940 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 -- 10.20.193.104:0/2172578940 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 895377530 0 0) 0x7ff64008af90 con 0x7ff64008ef90 2026-02-13T08:10:07.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient(hunting): my global_id is 27563 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 -- 10.20.193.104:0/2172578940 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff624003620 con 0x7ff64008ef90 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 -- 10.20.193.104:0/2172578940 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 202891412 0 0) 0x7ff640089fa0 con 0x7ff64008e4b0 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient(hunting): my global_id is 84135 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 -- 10.20.193.104:0/2172578940 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff64008af90 con 0x7ff64008e4b0 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 -- 10.20.193.104:0/2172578940 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3861184092 0 0) 0x7ff64008af90 con 0x7ff64008e4b0 2026-02-13T08:10:07.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 -- 10.20.193.104:0/2172578940 >> v1:10.20.193.104:6790/0 conn(0x7ff64008ef90 legacy=0x7ff64017e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 -- 10.20.193.104:0/2172578940 >> v1:10.20.193.119:6789/0 conn(0x7ff64017fe50 legacy=0x7ff6401a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient: _finish_hunting 0 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 monclient: found mon.noname-a 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 -- 10.20.193.104:0/2172578940 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64008b270 con 0x7ff64008e4b0 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient: _finish_auth 0 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient: _check_auth_tickets 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 -- 10.20.193.104:0/2172578940 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7ff62c002e00 con 0x7ff64008e4b0 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:10:07.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient: dump: 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 5 monclient: authenticate success, global_id 84135 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:07.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 -- 10.20.193.104:0/2172578940 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff62c003010 con 0x7ff64008e4b0 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 1 -- 10.20.193.104:0/2172578940 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7ff62c003450 con 0x7ff64008e4b0 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff63effd640 10 monclient: dump: 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.470 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.455+0000 7ff6465ba640 4 set_mon_vals no callback set 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: shutdown 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- 10.20.193.104:0/2172578940 >> v1:10.20.193.104:6789/0 conn(0x7ff64008e4b0 legacy=0x7ff64008e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- 10.20.193.104:0/2172578940 shutdown_connections 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- 10.20.193.104:0/2172578940 >> 10.20.193.104:0/2172578940 conn(0x7ff640051e80 msgr2=0x7ff64008c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- 10.20.193.104:0/2172578940 shutdown_connections 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- 10.20.193.104:0/2172578940 wait complete. 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: build_initial_monmap 2026-02-13T08:10:07.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: monmap: 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 librados: starting msgr at 2026-02-13T08:10:07.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 librados: starting objecter 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 Processor -- start 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- start start 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 librados: setting wanted keys 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 librados: calling monclient init 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: init 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient(hunting): picked mon.noname-b con 0x7ff64008e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient(hunting): picked mon.noname-a con 0x7ff64008ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient(hunting): picked mon.noname-c con 0x7ff64017fe50 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64007eaf0 con 0x7ff64008ef90 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64007f390 con 0x7ff64008e4b0 2026-02-13T08:10:07.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff640086790 con 0x7ff64017fe50 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient(hunting): authenticate will time out at 713.049023s 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff644b30640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7ff64017fe50 0x7ff640170730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47458/0 (socket says 10.20.193.104:47458) 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff644b30640 1 -- 10.20.193.104:0/1328785429 learned_addr learned my addr 10.20.193.104:0/1328785429 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63f7fe640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7ff64008ef90 0x7ff64016f010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:50326/0 (socket says 10.20.193.104:50326) 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 client.?.objecter ms_handle_connect 0x7ff64017fe50 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 client.?.objecter ms_handle_connect 0x7ff64008ef90 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168726312 0 0) 0x7ff640086790 con 0x7ff64017fe50 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): my global_id is 27566 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff610003620 con 0x7ff64017fe50 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2048751066 0 0) 0x7ff64007eaf0 con 0x7ff64008ef90 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): my global_id is 84138 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff640086790 con 0x7ff64008ef90 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 client.?.objecter ms_handle_connect 0x7ff64008e4b0 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2583817260 0 0) 0x7ff610003620 con 0x7ff64017fe50 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff64007eaf0 con 0x7ff64017fe50 2026-02-13T08:10:07.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7ff6340034a0 con 0x7ff64017fe50 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): dump: 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.476 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2905584548 0 0) 0x7ff640086790 con 0x7ff64008ef90 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff610003620 con 0x7ff64008ef90 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7ff6300031d0 con 0x7ff64008ef90 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): dump: 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.477 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026493302 0 0) 0x7ff64007f390 con 0x7ff64008e4b0 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient(hunting): my global_id is 74449 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff640086790 con 0x7ff64008e4b0 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4273513498 0 0) 0x7ff64007eaf0 con 0x7ff64017fe50 2026-02-13T08:10:07.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 >> v1:10.20.193.119:6789/0 conn(0x7ff64008e4b0 legacy=0x7ff6400838f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 >> v1:10.20.193.104:6789/0 conn(0x7ff64008ef90 legacy=0x7ff64016f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient: _finish_hunting 0 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 monclient: found mon.c 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64007e290 con 0x7ff64017fe50 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient: _finish_auth 0 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient: _check_auth_tickets 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 5 monclient: authenticate success, global_id 27566 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: _renew_subs 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- 10.20.193.104:0/1328785429 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff64007f0b0 con 0x7ff64017fe50 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 client.27566.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: _renew_subs 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- 10.20.193.104:0/1328785429 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff640084000 con 0x7ff64017fe50 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 librados: init done 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff634003830 con 0x7ff64017fe50 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7ff634003ee0 con 0x7ff64017fe50 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 monclient: dump: 2026-02-13T08:10:07.480 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63e7fc640 4 set_mon_vals no callback set 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:07.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff6465ba640 1 -- 10.20.193.104:0/1328785429 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff640061860 con 0x7ff64017fe50 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7ff634004080 con 0x7ff64017fe50 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(210..210 src has 1..210) ==== 4741+0+0 (unknown 3967587091 0 0) 0x7ff63404aa40 con 0x7ff64017fe50 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 client.27566.objecter ms_dispatch2 0x7ff640000ba0 osd_map(210..210 src has 1..210) 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 3 client.27566.objecter handle_osd_map got epochs [210,210] > 0 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 3 client.27566.objecter handle_osd_map decoding full epoch 210 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 20 client.27566.objecter dump_active .. 0 homeless 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63ffff640 10 monclient: get_auth_request con 0x7ff61003ba80 auth_method 0 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.459+0000 7ff63cff9640 10 client.27566.objecter ms_handle_connect 0x7ff61003ba80 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.463+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7ff634016fe0 con 0x7ff64017fe50 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.463+0000 7ff63cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:07.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.463+0000 7ff63cff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:07.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:10:07.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:10:07.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 1 -- 10.20.193.104:0/1328785429 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff64008cc70 con 0x7ff64017fe50 2026-02-13T08:10:07.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff63cff9640 1 -- 10.20.193.104:0/1328785429 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1475 (unknown 254746657 0 2083614570) 0x7ff6340168e0 con 0x7ff64017fe50 2026-02-13T08:10:07.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff63cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:10:07.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff63cff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:07.577 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:10:07.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 10 librados: watch_flush enter 2026-02-13T08:10:07.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 10 librados: watch_flush exit 2026-02-13T08:10:07.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 20 client.27566.objecter shutdown clearing up homeless session... 2026-02-13T08:10:07.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 10 client.27566.objecter successfully canceled tick 2026-02-13T08:10:07.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 1 -- 10.20.193.104:0/1328785429 >> v1:10.20.193.119:6812/276487904 conn(0x7ff61003ba80 legacy=0x7ff61005bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 10 monclient: shutdown 2026-02-13T08:10:07.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:07.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 1 -- 10.20.193.104:0/1328785429 >> v1:10.20.193.104:6790/0 conn(0x7ff64017fe50 legacy=0x7ff640170730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 1 -- 10.20.193.104:0/1328785429 shutdown_connections 2026-02-13T08:10:07.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 1 -- 10.20.193.104:0/1328785429 >> 10.20.193.104:0/1328785429 conn(0x7ff640051e80 msgr2=0x7ff6400878d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:07.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 1 -- 10.20.193.104:0/1328785429 shutdown_connections 2026-02-13T08:10:07.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 1 -- 10.20.193.104:0/1328785429 wait complete. 2026-02-13T08:10:07.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.575+0000 7ff6465ba640 1 librados: shutdown 2026-02-13T08:10:07.586 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T08:10:07.586 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T08:10:07.587 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T08:10:07.587 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T08:10:07.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient: get_monmap_and_config 2026-02-13T08:10:07.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient: build_initial_monmap 2026-02-13T08:10:07.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient: monmap: 2026-02-13T08:10:07.656 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:07.656 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.656 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:07.657923+0000 2026-02-13T08:10:07.656 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:07.657923+0000 2026-02-13T08:10:07.656 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:07.656 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.656 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:07.656 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:07.656 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:07.657 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.666 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 1 Processor -- start 2026-02-13T08:10:07.666 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 1 -- start start 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient: init 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient(hunting): picked mon.noname-b con 0x7f7250091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient(hunting): picked mon.noname-c con 0x7f725013f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient(hunting): picked mon.noname-a con 0x7f725013fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725008e5f0 con 0x7f725013fcd0 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725008e8d0 con 0x7f725013f870 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725008ebb0 con 0x7f7250091740 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient(hunting): authenticate will time out at 713.246884s 2026-02-13T08:10:07.667 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724f7fe640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f7250091740 0x7f725013f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47472/0 (socket says 10.20.193.104:47472) 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724f7fe640 1 -- 10.20.193.104:0/3155119439 learned_addr learned my addr 10.20.193.104:0/3155119439 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724ffff640 1 --1- 10.20.193.104:0/3155119439 >> v1:10.20.193.104:6789/0 conn(0x7f725013fcd0 0x7f72501a1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:50338/0 (socket says 10.20.193.104:50338) 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 -- 10.20.193.104:0/3155119439 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625521138 0 0) 0x7f725008e5f0 con 0x7f725013fcd0 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient(hunting): my global_id is 84141 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 -- 10.20.193.104:0/3155119439 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7234003620 con 0x7f725013fcd0 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 -- 10.20.193.104:0/3155119439 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1740996199 0 0) 0x7f725008ebb0 con 0x7f7250091740 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient(hunting): my global_id is 27569 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 -- 10.20.193.104:0/3155119439 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f725008e5f0 con 0x7f7250091740 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 -- 10.20.193.104:0/3155119439 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1451750150 0 0) 0x7f7234003620 con 0x7f725013fcd0 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 -- 10.20.193.104:0/3155119439 >> v1:10.20.193.104:6790/0 conn(0x7f7250091740 legacy=0x7f725013f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 -- 10.20.193.104:0/3155119439 >> v1:10.20.193.119:6789/0 conn(0x7f725013f870 legacy=0x7f7250180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient: _finish_hunting 0 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 monclient: found mon.noname-a 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 -- 10.20.193.104:0/3155119439 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7250091b10 con 0x7f725013fcd0 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient: _finish_auth 0 2026-02-13T08:10:07.669 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient: _check_auth_tickets 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 -- 10.20.193.104:0/3155119439 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f72440030b0 con 0x7f725013fcd0 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient: dump: 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.670 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 5 monclient: authenticate success, global_id 84141 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 -- 10.20.193.104:0/3155119439 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7244003300 con 0x7f725013fcd0 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 1 -- 10.20.193.104:0/3155119439 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7244003740 con 0x7f725013fcd0 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f724e7fc640 10 monclient: dump: 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.671 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 4 set_mon_vals no callback set 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 10 monclient: shutdown 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:07.672 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 1 -- 10.20.193.104:0/3155119439 >> v1:10.20.193.104:6789/0 conn(0x7f725013fcd0 legacy=0x7f72501a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 1 -- 10.20.193.104:0/3155119439 shutdown_connections 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 1 -- 10.20.193.104:0/3155119439 >> 10.20.193.104:0/3155119439 conn(0x7f7250090810 msgr2=0x7f7250090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 1 -- 10.20.193.104:0/3155119439 shutdown_connections 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.655+0000 7f7256043640 1 -- 10.20.193.104:0/3155119439 wait complete. 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient: build_initial_monmap 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient: monmap: 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:07.673 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 librados: starting msgr at 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 librados: starting objecter 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 Processor -- start 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 -- start start 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 librados: setting wanted keys 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 librados: calling monclient init 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient: init 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:07.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient(hunting): picked mon.noname-a con 0x7f7250091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient(hunting): picked mon.noname-c con 0x7f725013f870 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient(hunting): picked mon.noname-b con 0x7f725013fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f725008ce80 con 0x7f7250091740 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7250058cd0 con 0x7f725013fcd0 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7250058850 con 0x7f725013f870 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient(hunting): authenticate will time out at 713.249306s 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f724f7fe640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f7250091740 0x7f725014f9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:50350/0 (socket says 10.20.193.104:50350) 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f724f7fe640 1 -- 10.20.193.104:0/2104899545 learned_addr learned my addr 10.20.193.104:0/2104899545 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 client.?.objecter ms_handle_connect 0x7f7250091740 2026-02-13T08:10:07.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 client.?.objecter ms_handle_connect 0x7f725013f870 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1340102545 0 0) 0x7f725008ce80 con 0x7f7250091740 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): my global_id is 84144 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7220003620 con 0x7f7250091740 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102119688 0 0) 0x7f7250058850 con 0x7f725013f870 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): my global_id is 27572 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f725008ce80 con 0x7f725013f870 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2980165952 0 0) 0x7f725008ce80 con 0x7f725013f870 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7250058850 con 0x7f725013f870 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 client.?.objecter ms_handle_connect 0x7f725013fcd0 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f72400030a0 con 0x7f725013f870 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): dump: 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.677 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2140099974 0 0) 0x7f7220003620 con 0x7f7250091740 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f725008ce80 con 0x7f7250091740 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f723c003150 con 0x7f7250091740 2026-02-13T08:10:07.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): dump: 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1707938319 0 0) 0x7f7250058850 con 0x7f725013f870 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 >> v1:10.20.193.119:6789/0 conn(0x7f725013fcd0 legacy=0x7f7250192410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 >> v1:10.20.193.104:6789/0 conn(0x7f7250091740 legacy=0x7f725014f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: _finish_hunting 0 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 monclient: found mon.c 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725008d850 con 0x7f725013f870 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: _finish_auth 0 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: _check_auth_tickets 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 5 monclient: authenticate success, global_id 27572 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient: _renew_subs 2026-02-13T08:10:07.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f725008ab30 con 0x7f725013f870 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 client.27572.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient: _renew_subs 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7250130230 con 0x7f725013f870 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 librados: init done 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7240003450 con 0x7f725013f870 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7240003b60 con 0x7f725013f870 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:07.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: dump: 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f724dffb640 4 set_mon_vals no callback set 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:07.682 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f7256043640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7250061860 con 0x7f725012ea30 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f7240003d00 con 0x7f725013f870 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 client.27572.objecter ms_handle_connect 0x7f725012ea30 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 client.27572.objecter resend_mon_ops 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(210..210 src has 1..210) ==== 4741+0+0 (unknown 3967587091 0 0) 0x7f72400495a0 con 0x7f725013f870 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 client.27572.objecter ms_dispatch2 0x7f7250000ba0 osd_map(210..210 src has 1..210) 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 3 client.27572.objecter handle_osd_map got epochs [210,210] > 0 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 3 client.27572.objecter handle_osd_map decoding full epoch 210 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 20 client.27572.objecter dump_active .. 0 homeless 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632578685 0 0) 0x7f7250061860 con 0x7f725012ea30 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient(hunting): my global_id is 84147 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7250058850 con 0x7f725012ea30 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f724ffff640 10 monclient: get_auth_request con 0x7f722003b870 auth_method 0 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3723304749 0 0) 0x7f7250058850 con 0x7f725012ea30 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7250061860 con 0x7f725012ea30 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f723c0048e0 con 0x7f725012ea30 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: dump: 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.684 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4201099497 0 0) 0x7f7250061860 con 0x7f725012ea30 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f725012d420 con 0x7f725012ea30 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 client.27572.objecter ms_handle_connect 0x7f722003b870 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f723c004b30 con 0x7f725012ea30 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 >> v1:10.20.193.104:6789/0 conn(0x7f725012ea30 legacy=0x7f7250088990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.659+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 >> v1:10.20.193.104:6789/0 conn(0x7f725012ea30 legacy=0x7f7250088990 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f725012d710 con 0x7f72501500d0 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 10 client.27572.objecter ms_handle_connect 0x7f72501500d0 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 10 client.27572.objecter resend_mon_ops 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282980258 0 0) 0x7f725012d710 con 0x7f72501500d0 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 10 monclient(hunting): my global_id is 84150 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7250061860 con 0x7f72501500d0 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 103483476 0 0) 0x7f7250061860 con 0x7f72501500d0 2026-02-13T08:10:07.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f725012d710 con 0x7f72501500d0 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f723c005160 con 0x7f72501500d0 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 10 monclient: dump: 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.687 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.688 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1743138952 0 0) 0x7f725012d710 con 0x7f72501500d0 2026-02-13T08:10:07.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 --> v1:10.20.193.104:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f725004d110 con 0x7f72501500d0 2026-02-13T08:10:07.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4159 (unknown 0 0 1703396041) 0x7f723c0066e0 con 0x7f72501500d0 2026-02-13T08:10:07.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:10:07.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:07.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 >> v1:10.20.193.104:6789/0 conn(0x7f72501500d0 legacy=0x7f725004ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f722bfff640 1 -- 10.20.193.104:0/2104899545 >> v1:10.20.193.104:6789/0 conn(0x7f72501500d0 legacy=0x7f725004ca00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:07.689 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:10:07.689 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:10:07.689 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:10:07.689 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:10:07.689 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 38, 2026-02-13T08:10:07.689 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 16996, 2026-02-13T08:10:07.689 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:10:07.689 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:10:07.689 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:10:07.689 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:10:07.689 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 1, 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:07.690 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:07.691 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:10:07.692 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:07.693 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:10:07.694 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.695 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.696 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:07.697 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.698 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.699 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:10:07.699 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:10:07.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 10 librados: watch_flush enter 2026-02-13T08:10:07.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 10 librados: watch_flush exit 2026-02-13T08:10:07.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 20 client.27572.objecter shutdown clearing up homeless session... 2026-02-13T08:10:07.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 10 client.27572.objecter successfully canceled tick 2026-02-13T08:10:07.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 1 -- 10.20.193.104:0/2104899545 >> v1:10.20.193.119:6812/276487904 conn(0x7f722003b870 legacy=0x7f722005bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 10 monclient: shutdown 2026-02-13T08:10:07.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:07.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 1 -- 10.20.193.104:0/2104899545 >> v1:10.20.193.104:6790/0 conn(0x7f725013f870 legacy=0x7f7250190cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f724ffff640 1 -- 10.20.193.104:0/2104899545 reap_dead start 2026-02-13T08:10:07.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f724ffff640 1 -- 10.20.193.104:0/2104899545 reap_dead start 2026-02-13T08:10:07.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 1 -- 10.20.193.104:0/2104899545 shutdown_connections 2026-02-13T08:10:07.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 1 -- 10.20.193.104:0/2104899545 >> 10.20.193.104:0/2104899545 conn(0x7f7250090810 msgr2=0x7f725008c770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:07.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 1 -- 10.20.193.104:0/2104899545 shutdown_connections 2026-02-13T08:10:07.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 1 -- 10.20.193.104:0/2104899545 wait complete. 2026-02-13T08:10:07.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.663+0000 7f7256043640 1 librados: shutdown 2026-02-13T08:10:07.701 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:10:07.701 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T08:10:07.701 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T08:10:07.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.759+0000 7f326a16b640 10 monclient: get_monmap_and_config 2026-02-13T08:10:07.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.759+0000 7f326a16b640 10 monclient: build_initial_monmap 2026-02-13T08:10:07.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.759+0000 7f326a16b640 10 monclient: monmap: 2026-02-13T08:10:07.761 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:07.761 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.762 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:07.763570+0000 2026-02-13T08:10:07.762 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:07.763570+0000 2026-02-13T08:10:07.762 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:07.762 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.762 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:07.762 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:07.762 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:07.762 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.759+0000 7f326a16b640 1 Processor -- start 2026-02-13T08:10:07.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.759+0000 7f326a16b640 1 -- start start 2026-02-13T08:10:07.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.759+0000 7f326a16b640 10 monclient: init 2026-02-13T08:10:07.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:07.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:10:07.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient(hunting): picked mon.noname-c con 0x7f3264139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:07.768 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient(hunting): picked mon.noname-a con 0x7f326415e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient(hunting): picked mon.noname-b con 0x7f326417fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f326413aa00 con 0x7f326415e200 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f326408ba20 con 0x7f3264139f20 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3264089e30 con 0x7f326417fd00 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient(hunting): authenticate will time out at 713.352280s 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f3263fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f326417fd00 0x7f32641a00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47486/0 (socket says 10.20.193.104:47486) 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f3263fff640 1 -- 10.20.193.104:0/2003942247 learned_addr learned my addr 10.20.193.104:0/2003942247 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f3262ffd640 1 --1- 10.20.193.104:0/2003942247 >> v1:10.20.193.104:6789/0 conn(0x7f326415e200 0x7f326417e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:50376/0 (socket says 10.20.193.104:50376) 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 -- 10.20.193.104:0/2003942247 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320351093 0 0) 0x7f3254002920 con 0x7f326415e200 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient(hunting): my global_id is 84153 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 -- 10.20.193.104:0/2003942247 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3248003620 con 0x7f326415e200 2026-02-13T08:10:07.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 -- 10.20.193.104:0/2003942247 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 371847256 0 0) 0x7f3264089e30 con 0x7f326417fd00 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient(hunting): my global_id is 27575 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 -- 10.20.193.104:0/2003942247 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3254002920 con 0x7f326417fd00 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 -- 10.20.193.104:0/2003942247 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3224135908 0 0) 0x7f3254002920 con 0x7f326417fd00 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 -- 10.20.193.104:0/2003942247 >> v1:10.20.193.119:6789/0 conn(0x7f3264139f20 legacy=0x7f326413a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 -- 10.20.193.104:0/2003942247 >> v1:10.20.193.104:6789/0 conn(0x7f326415e200 legacy=0x7f326417e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient: _finish_hunting 0 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 monclient: found mon.noname-b 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 -- 10.20.193.104:0/2003942247 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f326408a380 con 0x7f326417fd00 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient: _finish_auth 0 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient: _check_auth_tickets 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:07.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 -- 10.20.193.104:0/2003942247 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3258003180 con 0x7f326417fd00 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient: dump: 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 5 monclient: authenticate success, global_id 27575 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 -- 10.20.193.104:0/2003942247 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3258003350 con 0x7f326417fd00 2026-02-13T08:10:07.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 1 -- 10.20.193.104:0/2003942247 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3258003790 con 0x7f326417fd00 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32627fc640 10 monclient: dump: 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 4 set_mon_vals no callback set 2026-02-13T08:10:07.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: shutdown 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- 10.20.193.104:0/2003942247 >> v1:10.20.193.104:6790/0 conn(0x7f326417fd00 legacy=0x7f32641a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- 10.20.193.104:0/2003942247 shutdown_connections 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- 10.20.193.104:0/2003942247 >> 10.20.193.104:0/2003942247 conn(0x7f3264051a50 msgr2=0x7f3264051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- 10.20.193.104:0/2003942247 shutdown_connections 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- 10.20.193.104:0/2003942247 wait complete. 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: build_initial_monmap 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: monmap: 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:07.773 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 librados: starting msgr at 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 librados: starting objecter 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 Processor -- start 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- start start 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 librados: setting wanted keys 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 librados: calling monclient init 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: init 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient(hunting): picked mon.noname-c con 0x7f3264139f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient(hunting): picked mon.noname-a con 0x7f326415e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient(hunting): picked mon.noname-b con 0x7f326417fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3264164250 con 0x7f326415e200 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32641627c0 con 0x7f326417fd00 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f326417ef60 con 0x7f3264139f20 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:07.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient(hunting): authenticate will time out at 713.354160s 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32637fe640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f3264139f20 0x7f326417e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47494/0 (socket says 10.20.193.104:47494) 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f32637fe640 1 -- 10.20.193.104:0/3492236506 learned_addr learned my addr 10.20.193.104:0/3492236506 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 client.?.objecter ms_handle_connect 0x7f3264139f20 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 client.?.objecter ms_handle_connect 0x7f326415e200 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 490779856 0 0) 0x7f326417ef60 con 0x7f3264139f20 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): my global_id is 27578 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3234003620 con 0x7f3264139f20 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1009758826 0 0) 0x7f3264164250 con 0x7f326415e200 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): my global_id is 84156 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f326417ef60 con 0x7f326415e200 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 client.?.objecter ms_handle_connect 0x7f326417fd00 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3186429744 0 0) 0x7f3234003620 con 0x7f3264139f20 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3264164250 con 0x7f3264139f20 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f32500031a0 con 0x7f3264139f20 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): dump: 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.776 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2733918735 0 0) 0x7f32641627c0 con 0x7f326417fd00 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): my global_id is 74458 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3234003620 con 0x7f326417fd00 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3338769709 0 0) 0x7f326417ef60 con 0x7f326415e200 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32641627c0 con 0x7f326415e200 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 514138227 0 0) 0x7f3264164250 con 0x7f3264139f20 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 >> v1:10.20.193.119:6789/0 conn(0x7f326417fd00 legacy=0x7f3264126aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 >> v1:10.20.193.104:6789/0 conn(0x7f326415e200 legacy=0x7f326417e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: _finish_hunting 0 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 monclient: found mon.c 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:07.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3264086620 con 0x7f3264139f20 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: _finish_auth 0 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: _check_auth_tickets 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 5 monclient: authenticate success, global_id 27578 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: _renew_subs 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3264162d60 con 0x7f3264139f20 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 client.27578.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: _renew_subs 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f326417fab0 con 0x7f3264139f20 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 librados: init done 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32500039c0 con 0x7f3264139f20 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3250003b70 con 0x7f3264139f20 2026-02-13T08:10:07.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: dump: 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f3261ffb640 4 set_mon_vals no callback set 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f326a16b640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3264061860 con 0x7f3264086930 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 client.27578.objecter ms_handle_connect 0x7f3264086930 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 client.27578.objecter resend_mon_ops 2026-02-13T08:10:07.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f3250003d10 con 0x7f3264139f20 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(211..211 src has 1..211) ==== 5425+0+0 (unknown 1003589350 0 0) 0x7f325004a9e0 con 0x7f3264139f20 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 client.27578.objecter ms_dispatch2 0x7f3264000ba0 osd_map(211..211 src has 1..211) 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 3 client.27578.objecter handle_osd_map got epochs [211,211] > 0 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 3 client.27578.objecter handle_osd_map decoding full epoch 211 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 20 client.27578.objecter dump_active .. 0 homeless 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898967493 0 0) 0x7f3264061860 con 0x7f3264086930 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient(hunting): my global_id is 27581 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3264164250 con 0x7f3264086930 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2823177441 0 0) 0x7f3264164250 con 0x7f3264086930 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3264061860 con 0x7f3264086930 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f32540048e0 con 0x7f3264086930 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:07.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: dump: 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f3263fff640 10 monclient: get_auth_request con 0x7f323403b990 auth_method 0 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1869709500 0 0) 0x7f3264061860 con 0x7f3264086930 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3264163b80 con 0x7f3264086930 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 client.27578.objecter ms_handle_connect 0x7f323403b990 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f3254006b40 con 0x7f3264086930 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:07.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:07.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 >> v1:10.20.193.104:6790/0 conn(0x7f3264086930 legacy=0x7f3264086d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.763+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 >> v1:10.20.193.104:6790/0 conn(0x7f3264086930 legacy=0x7f3264086d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:07.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f326a16b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:10:07.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f326a16b640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3264087810 con 0x7f3264087410 2026-02-13T08:10:07.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 10 client.27578.objecter ms_handle_connect 0x7f3264087410 2026-02-13T08:10:07.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 10 client.27578.objecter resend_mon_ops 2026-02-13T08:10:07.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723529432 0 0) 0x7f3264087810 con 0x7f3264087410 2026-02-13T08:10:07.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 10 monclient(hunting): my global_id is 27584 2026-02-13T08:10:07.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3264061860 con 0x7f3264087410 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2163978303 0 0) 0x7f3264061860 con 0x7f3264087410 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3264087810 con 0x7f3264087410 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f32540060e0 con 0x7f3264087410 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 10 monclient: dump: 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3172800501 0 0) 0x7f3264087810 con 0x7f3264087410 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 --> v1:10.20.193.104:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3264088e20 con 0x7f3264087410 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4492 (unknown 0 0 3505683675) 0x7f3254006120 con 0x7f3264087410 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 >> v1:10.20.193.104:6790/0 conn(0x7f3264087410 legacy=0x7f32641291d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.767+0000 7f323ffff640 1 -- 10.20.193.104:0/3492236506 >> v1:10.20.193.104:6790/0 conn(0x7f3264087410 legacy=0x7f32641291d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 38, 2026-02-13T08:10:07.785 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 277174, 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 2, 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:07.786 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:07.787 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:10:07.788 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:07.789 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.790 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.791 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.792 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.793 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: "num": 4 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.794 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.795 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.795 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:10:07.795 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 10 librados: watch_flush enter 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 10 librados: watch_flush exit 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 20 client.27578.objecter shutdown clearing up homeless session... 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 10 client.27578.objecter successfully canceled tick 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 1 -- 10.20.193.104:0/3492236506 >> v1:10.20.193.119:6812/276487904 conn(0x7f323403b990 legacy=0x7f323405be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 10 monclient: shutdown 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 1 -- 10.20.193.104:0/3492236506 >> v1:10.20.193.104:6790/0 conn(0x7f3264139f20 legacy=0x7f326417e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f3263fff640 1 -- 10.20.193.104:0/3492236506 reap_dead start 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f3263fff640 1 -- 10.20.193.104:0/3492236506 reap_dead start 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 1 -- 10.20.193.104:0/3492236506 shutdown_connections 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 1 -- 10.20.193.104:0/3492236506 >> 10.20.193.104:0/3492236506 conn(0x7f3264051a50 msgr2=0x7f326408c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 1 -- 10.20.193.104:0/3492236506 shutdown_connections 2026-02-13T08:10:07.796 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 1 -- 10.20.193.104:0/3492236506 wait complete. 2026-02-13T08:10:07.797 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.771+0000 7f326a16b640 1 librados: shutdown 2026-02-13T08:10:07.797 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:10:07.797 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T08:10:07.797 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T08:10:07.859 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient: get_monmap_and_config 2026-02-13T08:10:07.859 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient: build_initial_monmap 2026-02-13T08:10:07.859 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient: monmap: 2026-02-13T08:10:07.859 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:07.860 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.860 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:07.861873+0000 2026-02-13T08:10:07.860 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:07.861873+0000 2026-02-13T08:10:07.860 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:07.860 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.860 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:07.860 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:07.860 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:07.860 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 1 Processor -- start 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 1 -- start start 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient: init 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient(hunting): picked mon.noname-b con 0x7fe6ec139f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient(hunting): picked mon.noname-c con 0x7fe6ec15e200 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient(hunting): picked mon.noname-a con 0x7fe6ec17fd00 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec13aa00 con 0x7fe6ec17fd00 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec08ba20 con 0x7fe6ec15e200 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec089e30 con 0x7fe6ec139f20 2026-02-13T08:10:07.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient(hunting): authenticate will time out at 713.450588s 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6ebfff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fe6ec139f20 0x7fe6ec13a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47522/0 (socket says 10.20.193.104:47522) 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6ebfff640 1 -- 10.20.193.104:0/2250765942 learned_addr learned my addr 10.20.193.104:0/2250765942 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f099c640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fe6ec17fd00 0x7fe6ec1a00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:50396/0 (socket says 10.20.193.104:50396) 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 -- 10.20.193.104:0/2250765942 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073601516 0 0) 0x7fe6ec089e30 con 0x7fe6ec139f20 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient(hunting): my global_id is 27587 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 -- 10.20.193.104:0/2250765942 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6d0003620 con 0x7fe6ec139f20 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 -- 10.20.193.104:0/2250765942 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 226114227 0 0) 0x7fe6e0002bd0 con 0x7fe6ec17fd00 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient(hunting): my global_id is 84159 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 -- 10.20.193.104:0/2250765942 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ec089e30 con 0x7fe6ec17fd00 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 -- 10.20.193.104:0/2250765942 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3239252286 0 0) 0x7fe6d0003620 con 0x7fe6ec139f20 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 -- 10.20.193.104:0/2250765942 >> v1:10.20.193.119:6789/0 conn(0x7fe6ec15e200 legacy=0x7fe6ec17e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 -- 10.20.193.104:0/2250765942 >> v1:10.20.193.104:6789/0 conn(0x7fe6ec17fd00 legacy=0x7fe6ec1a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient: _finish_hunting 0 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 monclient: found mon.noname-b 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 -- 10.20.193.104:0/2250765942 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec08a380 con 0x7fe6ec139f20 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient: _finish_auth 0 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient: _check_auth_tickets 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 5 monclient: authenticate success, global_id 27587 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:07.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 -- 10.20.193.104:0/2250765942 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fe6d8002e00 con 0x7fe6ec139f20 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient: dump: 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 -- 10.20.193.104:0/2250765942 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6d8002fd0 con 0x7fe6ec139f20 2026-02-13T08:10:07.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 1 -- 10.20.193.104:0/2250765942 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fe6d8003410 con 0x7fe6ec139f20 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 4 set_mon_vals no callback set 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6eaffd640 10 monclient: dump: 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.872 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 10 monclient: shutdown 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 1 -- 10.20.193.104:0/2250765942 >> v1:10.20.193.104:6790/0 conn(0x7fe6ec139f20 legacy=0x7fe6ec13a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 1 -- 10.20.193.104:0/2250765942 shutdown_connections 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 1 -- 10.20.193.104:0/2250765942 >> 10.20.193.104:0/2250765942 conn(0x7fe6ec051a50 msgr2=0x7fe6ec051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 1 -- 10.20.193.104:0/2250765942 shutdown_connections 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.859+0000 7fe6f2426640 1 -- 10.20.193.104:0/2250765942 wait complete. 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient: build_initial_monmap 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient: monmap: 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:07.873 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 librados: starting msgr at 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 librados: starting objecter 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 Processor -- start 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 -- start start 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 librados: setting wanted keys 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 librados: calling monclient init 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient: init 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient(hunting): picked mon.noname-b con 0x7fe6ec139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient(hunting): picked mon.noname-a con 0x7fe6ec15e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:07.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient(hunting): picked mon.noname-c con 0x7fe6ec17fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec162870 con 0x7fe6ec15e200 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec165170 con 0x7fe6ec139f20 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6ec17f010 con 0x7fe6ec17fd00 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient(hunting): authenticate will time out at 713.452666s 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f099c640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fe6ec17fd00 0x7fe6ec126aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47538/0 (socket says 10.20.193.104:47538) 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f099c640 1 -- 10.20.193.104:0/2747290502 learned_addr learned my addr 10.20.193.104:0/2747290502 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6eb7fe640 1 --1- 10.20.193.104:0/2747290502 >> v1:10.20.193.104:6789/0 conn(0x7fe6ec15e200 0x7fe6ec17e900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:50398/0 (socket says 10.20.193.104:50398) 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 client.?.objecter ms_handle_connect 0x7fe6ec15e200 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 client.?.objecter ms_handle_connect 0x7fe6ec17fd00 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657202646 0 0) 0x7fe6ec17f010 con 0x7fe6ec17fd00 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): my global_id is 27590 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6bc003620 con 0x7fe6ec17fd00 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521688813 0 0) 0x7fe6ec162870 con 0x7fe6ec15e200 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): my global_id is 84162 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ec17f010 con 0x7fe6ec15e200 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3425765440 0 0) 0x7fe6bc003620 con 0x7fe6ec17fd00 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6ec162870 con 0x7fe6ec17fd00 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fe6e00034b0 con 0x7fe6ec17fd00 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): dump: 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.876 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 client.?.objecter ms_handle_connect 0x7fe6ec139f20 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1949399827 0 0) 0x7fe6ec17f010 con 0x7fe6ec15e200 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6bc003620 con 0x7fe6ec15e200 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fe6dc003030 con 0x7fe6ec15e200 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:07.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): dump: 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2274171630 0 0) 0x7fe6bc003620 con 0x7fe6ec15e200 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 >> v1:10.20.193.104:6790/0 conn(0x7fe6ec17fd00 legacy=0x7fe6ec126aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 >> v1:10.20.193.119:6789/0 conn(0x7fe6ec139f20 legacy=0x7fe6ec17e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: _finish_hunting 0 2026-02-13T08:10:07.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 monclient: found mon.a 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6ec05d2c0 con 0x7fe6ec15e200 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: _finish_auth 0 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: _check_auth_tickets 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 5 monclient: authenticate success, global_id 84162 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient: _renew_subs 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe6ec086620 con 0x7fe6ec15e200 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 client.84162.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient: _renew_subs 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe6ec164e90 con 0x7fe6ec15e200 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 librados: init done 2026-02-13T08:10:07.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe6dc003710 con 0x7fe6ec15e200 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fe6dc003a60 con 0x7fe6ec15e200 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6ea7fc640 4 set_mon_vals no callback set 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: dump: 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.880 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f2426640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe6ec163c90 con 0x7fe6ec13bbf0 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fe6dc003c00 con 0x7fe6ec15e200 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 client.84162.objecter ms_handle_connect 0x7fe6ec13bbf0 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 client.84162.objecter resend_mon_ops 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(211..211 src has 1..211) ==== 5425+0+0 (unknown 1003589350 0 0) 0x7fe6dc04a8d0 con 0x7fe6ec15e200 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 client.84162.objecter ms_dispatch2 0x7fe6ec000ba0 osd_map(211..211 src has 1..211) 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 3 client.84162.objecter handle_osd_map got epochs [211,211] > 0 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 3 client.84162.objecter handle_osd_map decoding full epoch 211 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 20 client.84162.objecter dump_active .. 0 homeless 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1608295037 0 0) 0x7fe6ec163c90 con 0x7fe6ec13bbf0 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient(hunting): my global_id is 74467 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6bc003620 con 0x7fe6ec13bbf0 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6f099c640 10 monclient: get_auth_request con 0x7fe6bc03bac0 auth_method 0 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2676247316 0 0) 0x7fe6bc003620 con 0x7fe6ec13bbf0 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6ec163c90 con 0x7fe6ec13bbf0 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fe6d8002c50 con 0x7fe6ec13bbf0 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: dump: 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.882 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 client.84162.objecter ms_handle_connect 0x7fe6bc03bac0 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 508378858 0 0) 0x7fe6ec163c90 con 0x7fe6ec13bbf0 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.119:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe6ec061860 con 0x7fe6ec13bbf0 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7fe6d8002bb0 con 0x7fe6ec13bbf0 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 >> v1:10.20.193.119:6789/0 conn(0x7fe6ec13bbf0 legacy=0x7fe6ec13bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.863+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 >> v1:10.20.193.119:6789/0 conn(0x7fe6ec13bbf0 legacy=0x7fe6ec13bfc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:10:07.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe6ec1648d0 con 0x7fe6ec13c6d0 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 10 client.84162.objecter ms_handle_connect 0x7fe6ec13c6d0 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 10 client.84162.objecter resend_mon_ops 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642825210 0 0) 0x7fe6ec1648d0 con 0x7fe6ec13c6d0 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 10 monclient(hunting): my global_id is 74470 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6ec163c90 con 0x7fe6ec13c6d0 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1848210028 0 0) 0x7fe6ec163c90 con 0x7fe6ec13c6d0 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6ec1648d0 con 0x7fe6ec13c6d0 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fe6d80048e0 con 0x7fe6ec13c6d0 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:10:07.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 10 monclient: dump: 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3108712192 0 0) 0x7fe6ec1648d0 con 0x7fe6ec13c6d0 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 --> v1:10.20.193.119:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe6ec13cad0 con 0x7fe6ec13c6d0 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4325 (unknown 0 0 1427800413) 0x7fe6d8005d20 con 0x7fe6ec13c6d0 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:10:07.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:07.887 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 >> v1:10.20.193.119:6789/0 conn(0x7fe6ec13c6d0 legacy=0x7fe6ec1291d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.887 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6e8ff9640 1 -- 10.20.193.104:0/2747290502 >> v1:10.20.193.119:6789/0 conn(0x7fe6ec13c6d0 legacy=0x7fe6ec1291d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:07.887 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:10:07.887 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:10:07.887 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:10:07.887 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:10:07.887 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 38, 2026-02-13T08:10:07.887 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 144888, 2026-02-13T08:10:07.887 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:10:07.887 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:10:07.887 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 2, 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:07.888 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:07.889 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:10:07.890 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.891 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.892 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.893 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:10:07.894 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:10:07.895 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:07.896 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:07.896 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:07.896 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:10:07.896 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:10:07.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 10 librados: watch_flush enter 2026-02-13T08:10:07.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 10 librados: watch_flush exit 2026-02-13T08:10:07.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 20 client.84162.objecter shutdown clearing up homeless session... 2026-02-13T08:10:07.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 10 client.84162.objecter successfully canceled tick 2026-02-13T08:10:07.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 1 -- 10.20.193.104:0/2747290502 >> v1:10.20.193.119:6812/276487904 conn(0x7fe6bc03bac0 legacy=0x7fe6bc05bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 10 monclient: shutdown 2026-02-13T08:10:07.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:07.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 1 -- 10.20.193.104:0/2747290502 >> v1:10.20.193.104:6789/0 conn(0x7fe6ec15e200 legacy=0x7fe6ec17e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:07.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f099c640 1 -- 10.20.193.104:0/2747290502 reap_dead start 2026-02-13T08:10:07.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 1 -- 10.20.193.104:0/2747290502 shutdown_connections 2026-02-13T08:10:07.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 1 -- 10.20.193.104:0/2747290502 >> 10.20.193.104:0/2747290502 conn(0x7fe6ec051a50 msgr2=0x7fe6ec05bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:07.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 1 -- 10.20.193.104:0/2747290502 shutdown_connections 2026-02-13T08:10:07.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 1 -- 10.20.193.104:0/2747290502 wait complete. 2026-02-13T08:10:07.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:07.867+0000 7fe6f2426640 1 librados: shutdown 2026-02-13T08:10:07.898 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:10:07.898 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a'] 2026-02-13T08:10:07.898 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-13T08:10:07.898 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2026-02-13T08:10:07.898 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2026-02-13T08:10:07.898 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T08:10:07.898 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:10:07.908 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T08:10:07.908 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T08:10:07.908 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:10:08.014 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: get_monmap_and_config 2026-02-13T08:10:08.014 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: build_initial_monmap 2026-02-13T08:10:08.014 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: monmap: 2026-02-13T08:10:08.014 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:08.014 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:08.014 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:08.016147+0000 2026-02-13T08:10:08.014 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:08.016147+0000 2026-02-13T08:10:08.014 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:08.014 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:08.015 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:08.015 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:08.015 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:08.015 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:08.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 Processor -- start 2026-02-13T08:10:08.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- start start 2026-02-13T08:10:08.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: init 2026-02-13T08:10:08.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:08.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:10:08.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient(hunting): picked mon.noname-b con 0x7f642008e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:08.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient(hunting): picked mon.noname-a con 0x7f642008ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:08.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient(hunting): picked mon.noname-c con 0x7f642017fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:08.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6420089fa0 con 0x7f642008ef90 2026-02-13T08:10:08.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6420089760 con 0x7f642017fe50 2026-02-13T08:10:08.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642008af90 con 0x7f642008e4b0 2026-02-13T08:10:08.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:08.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient(hunting): authenticate will time out at 713.604837s 2026-02-13T08:10:08.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641e7fc640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7f642008ef90 legacy=0x7f642017e730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:08.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641effd640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f642008e4b0 0x7f642008e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47542/0 (socket says 10.20.193.104:47542) 2026-02-13T08:10:08.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641effd640 1 -- 10.20.193.104:0/3310759909 learned_addr learned my addr 10.20.193.104:0/3310759909 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:08.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 1 -- 10.20.193.104:0/3310759909 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699390186 0 0) 0x7f642008af90 con 0x7f642008e4b0 2026-02-13T08:10:08.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient(hunting): _negotiate 2026-02-13T08:10:08.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:08.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:08.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient(hunting): my global_id is 27593 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 1 -- 10.20.193.104:0/3310759909 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f640c003620 con 0x7f642008e4b0 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 1 -- 10.20.193.104:0/3310759909 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3779464355 0 0) 0x7f640c003620 con 0x7f642008e4b0 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 1 -- 10.20.193.104:0/3310759909 >> v1:10.20.193.119:6789/0 conn(0x7f642017fe50 legacy=0x7f64201a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 1 -- 10.20.193.104:0/3310759909 >> v1:10.20.193.104:6789/0 conn(0x7f642008ef90 legacy=0x7f642017e730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient: _finish_hunting 0 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 1 monclient: found mon.noname-b 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 1 -- 10.20.193.104:0/3310759909 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642008b270 con 0x7f642008e4b0 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient: _finish_auth 0 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient: _check_auth_tickets 2026-02-13T08:10:08.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 1 -- 10.20.193.104:0/3310759909 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6414002e00 con 0x7f642008e4b0 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient: dump: 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:08.025 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:08.026 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:08.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 5 monclient: authenticate success, global_id 27593 2026-02-13T08:10:08.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:08.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 1 -- 10.20.193.104:0/3310759909 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6414003100 con 0x7f642008e4b0 2026-02-13T08:10:08.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:08.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 1 -- 10.20.193.104:0/3310759909 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6414003540 con 0x7f642008e4b0 2026-02-13T08:10:08.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:08.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:08.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641dffb640 10 monclient: dump: 2026-02-13T08:10:08.026 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:08.026 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 4 set_mon_vals no callback set 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: shutdown 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:08.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- 10.20.193.104:0/3310759909 >> v1:10.20.193.104:6790/0 conn(0x7f642008e4b0 legacy=0x7f642008e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:08.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- 10.20.193.104:0/3310759909 shutdown_connections 2026-02-13T08:10:08.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- 10.20.193.104:0/3310759909 >> 10.20.193.104:0/3310759909 conn(0x7f6420051e80 msgr2=0x7f642008c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:08.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- 10.20.193.104:0/3310759909 shutdown_connections 2026-02-13T08:10:08.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- 10.20.193.104:0/3310759909 wait complete. 2026-02-13T08:10:08.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: build_initial_monmap 2026-02-13T08:10:08.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: monmap: 2026-02-13T08:10:08.028 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:08.028 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:08.028 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:08.028 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:08.028 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 librados: starting msgr at 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 librados: starting objecter 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 Processor -- start 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- start start 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 librados: setting wanted keys 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 librados: calling monclient init 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: init 2026-02-13T08:10:08.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient(hunting): picked mon.noname-c con 0x7f642008e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient(hunting): picked mon.noname-a con 0x7f642008ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient(hunting): picked mon.noname-b con 0x7f642017fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6420088a10 con 0x7f642008ef90 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6420088540 con 0x7f642017fe50 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6420187710 con 0x7f642008e4b0 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641e7fc640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7f642008ef90 legacy=0x7f642019caf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient(hunting): authenticate will time out at 713.607281s 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641effd640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f642008e4b0 0x7f642019ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47548/0 (socket says 10.20.193.104:47548) 2026-02-13T08:10:08.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641effd640 1 -- 10.20.193.104:0/942069607 learned_addr learned my addr 10.20.193.104:0/942069607 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 client.?.objecter ms_handle_connect 0x7f642008e4b0 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4278301462 0 0) 0x7f6420187710 con 0x7f642008e4b0 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient(hunting): my global_id is 27596 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63ec003620 con 0x7f642008e4b0 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 client.?.objecter ms_handle_connect 0x7f642017fe50 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3670338294 0 0) 0x7f63ec003620 con 0x7f642008e4b0 2026-02-13T08:10:08.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6420187710 con 0x7f642008e4b0 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6414002dc0 con 0x7f642008e4b0 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient(hunting): dump: 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:08.032 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1817255319 0 0) 0x7f6420187710 con 0x7f642008e4b0 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 >> v1:10.20.193.119:6789/0 conn(0x7f642017fe50 legacy=0x7f642019e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 >> v1:10.20.193.104:6789/0 conn(0x7f642008ef90 legacy=0x7f642019caf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 monclient: found mon.c 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64201879f0 con 0x7f642008e4b0 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient: _finish_auth 0 2026-02-13T08:10:08.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 5 monclient: authenticate success, global_id 27596 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: _renew_subs 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- 10.20.193.104:0/942069607 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6420059c30 con 0x7f642008e4b0 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 client.27596.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: _renew_subs 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 -- 10.20.193.104:0/942069607 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f642018a910 con 0x7f642008e4b0 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f6425735640 1 librados: init done 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6414004d60 con 0x7f642008e4b0 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:08.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f64140050b0 con 0x7f642008e4b0 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f63ff7fe640 10 monclient: dump: 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:08.035 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.015+0000 7f641d7fa640 4 set_mon_vals no callback set 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f6425735640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f6425735640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f6425735640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f6425735640 1 -- 10.20.193.104:0/942069607 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642008e180 con 0x7f642008e4b0 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f64140110c0 con 0x7f642008e4b0 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(211..211 src has 1..211) ==== 5425+0+0 (unknown 1003589350 0 0) 0x7f641404a8f0 con 0x7f642008e4b0 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f63ff7fe640 10 client.27596.objecter ms_dispatch2 0x7f6420000ba0 osd_map(211..211 src has 1..211) 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f63ff7fe640 3 client.27596.objecter handle_osd_map got epochs [211,211] > 0 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f63ff7fe640 3 client.27596.objecter handle_osd_map decoding full epoch 211 2026-02-13T08:10:08.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f63ff7fe640 20 client.27596.objecter dump_active .. 0 homeless 2026-02-13T08:10:08.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f641e7fc640 10 monclient: get_auth_request con 0x7f63ec03b6f0 auth_method 0 2026-02-13T08:10:08.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f63ff7fe640 10 client.27596.objecter ms_handle_connect 0x7f63ec03b6f0 2026-02-13T08:10:08.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f6414016d00 con 0x7f642008e4b0 2026-02-13T08:10:08.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f63ff7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:08.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.019+0000 7f63ff7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:08.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:10:08.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:10:08.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:08.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 1 -- 10.20.193.104:0/942069607 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f642005b370 con 0x7f642008e4b0 2026-02-13T08:10:08.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f63ff7fe640 1 -- 10.20.193.104:0/942069607 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1475 (unknown 254746657 0 1299713513) 0x7f6414016600 con 0x7f642008e4b0 2026-02-13T08:10:08.136 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f63ff7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:10:08.136 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f63ff7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:08.136 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:10:08.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 10 librados: watch_flush enter 2026-02-13T08:10:08.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 10 librados: watch_flush exit 2026-02-13T08:10:08.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 20 client.27596.objecter shutdown clearing up homeless session... 2026-02-13T08:10:08.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 10 client.27596.objecter successfully canceled tick 2026-02-13T08:10:08.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 1 -- 10.20.193.104:0/942069607 >> v1:10.20.193.119:6812/276487904 conn(0x7f63ec03b6f0 legacy=0x7f63ec05bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:08.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 10 monclient: shutdown 2026-02-13T08:10:08.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:08.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 1 -- 10.20.193.104:0/942069607 >> v1:10.20.193.104:6790/0 conn(0x7f642008e4b0 legacy=0x7f642019ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:08.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 1 -- 10.20.193.104:0/942069607 shutdown_connections 2026-02-13T08:10:08.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 1 -- 10.20.193.104:0/942069607 >> 10.20.193.104:0/942069607 conn(0x7f6420051e80 msgr2=0x7f6420058790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:08.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 1 -- 10.20.193.104:0/942069607 shutdown_connections 2026-02-13T08:10:08.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 1 -- 10.20.193.104:0/942069607 wait complete. 2026-02-13T08:10:08.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:08.135+0000 7f6425735640 1 librados: shutdown 2026-02-13T08:10:11.145 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:10:11.219 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient: get_monmap_and_config 2026-02-13T08:10:11.219 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient: build_initial_monmap 2026-02-13T08:10:11.219 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient: monmap: 2026-02-13T08:10:11.219 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:11.219 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:11.219 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:11.221335+0000 2026-02-13T08:10:11.220 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:11.221335+0000 2026-02-13T08:10:11.220 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:11.220 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:11.220 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:11.220 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:11.220 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:11.220 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:11.228 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 Processor -- start 2026-02-13T08:10:11.228 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 -- start start 2026-02-13T08:10:11.228 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient: init 2026-02-13T08:10:11.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:11.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:10:11.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient(hunting): picked mon.noname-c con 0x7fedf008f990 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:11.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient(hunting): picked mon.noname-b con 0x7fedf0051f90 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:11.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient(hunting): picked mon.noname-a con 0x7fedf00523a0 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:11.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf00875f0 con 0x7fedf00523a0 2026-02-13T08:10:11.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf008ecd0 con 0x7fedf008f990 2026-02-13T08:10:11.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf008e710 con 0x7fedf0051f90 2026-02-13T08:10:11.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:11.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient(hunting): authenticate will time out at 716.810095s 2026-02-13T08:10:11.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf49cb640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7fedf00523a0 legacy=0x7fedf01a1df0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedef7fe640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fedf0051f90 0x7fedf01806c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47550/0 (socket says 10.20.193.104:47550) 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedef7fe640 1 -- 10.20.193.104:0/2655873800 learned_addr learned my addr 10.20.193.104:0/2655873800 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 1 -- 10.20.193.104:0/2655873800 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012757248 0 0) 0x7fedf008e710 con 0x7fedf0051f90 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient(hunting): my global_id is 27599 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 1 -- 10.20.193.104:0/2655873800 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedd4003620 con 0x7fedf0051f90 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 1 -- 10.20.193.104:0/2655873800 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3507253263 0 0) 0x7fedd4003620 con 0x7fedf0051f90 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 1 -- 10.20.193.104:0/2655873800 >> v1:10.20.193.119:6789/0 conn(0x7fedf008f990 legacy=0x7fedf0051880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 1 -- 10.20.193.104:0/2655873800 >> v1:10.20.193.104:6789/0 conn(0x7fedf00523a0 legacy=0x7fedf01a1df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:10:11.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient: _finish_hunting 0 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 1 monclient: found mon.noname-b 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 1 -- 10.20.193.104:0/2655873800 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf008e9f0 con 0x7fedf0051f90 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient: _finish_auth 0 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient: _check_auth_tickets 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 1 -- 10.20.193.104:0/2655873800 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fede0002e00 con 0x7fedf0051f90 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient: dump: 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:11.231 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 5 monclient: authenticate success, global_id 27599 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 1 -- 10.20.193.104:0/2655873800 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fede0003090 con 0x7fedf0051f90 2026-02-13T08:10:11.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 1 -- 10.20.193.104:0/2655873800 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fede00034d0 con 0x7fedf0051f90 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedeeffd640 10 monclient: dump: 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:11.233 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 4 set_mon_vals no callback set 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient: shutdown 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 -- 10.20.193.104:0/2655873800 >> v1:10.20.193.104:6790/0 conn(0x7fedf0051f90 legacy=0x7fedf01806c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 -- 10.20.193.104:0/2655873800 shutdown_connections 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 -- 10.20.193.104:0/2655873800 >> 10.20.193.104:0/2655873800 conn(0x7fedf008d1c0 msgr2=0x7fedf008d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 -- 10.20.193.104:0/2655873800 shutdown_connections 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 -- 10.20.193.104:0/2655873800 wait complete. 2026-02-13T08:10:11.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient: build_initial_monmap 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 10 monclient: monmap: 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 librados: starting msgr at 2026-02-13T08:10:11.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 librados: starting objecter 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.219+0000 7fedf6455640 1 Processor -- start 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 1 -- start start 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 1 librados: setting wanted keys 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 1 librados: calling monclient init 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient: init 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient(hunting): picked mon.noname-c con 0x7fedf0051f90 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient(hunting): picked mon.noname-b con 0x7fedf00523a0 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient(hunting): picked mon.noname-a con 0x7fedf008f990 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf012b550 con 0x7fedf008f990 2026-02-13T08:10:11.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf012b830 con 0x7fedf00523a0 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedf0089ce0 con 0x7fedf0051f90 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient(hunting): authenticate will time out at 716.812421s 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf49cb640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7fedf008f990 legacy=0x7fedf01a16e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedeffff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fedf0051f90 0x7fedf0110f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47554/0 (socket says 10.20.193.104:47554) 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedeffff640 1 -- 10.20.193.104:0/196561915 learned_addr learned my addr 10.20.193.104:0/196561915 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 client.?.objecter ms_handle_connect 0x7fedf0051f90 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195424848 0 0) 0x7fedf0089ce0 con 0x7fedf0051f90 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient(hunting): _negotiate 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:11.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient(hunting): my global_id is 27602 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedc0003620 con 0x7fedf0051f90 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1703152105 0 0) 0x7fedc0003620 con 0x7fedf0051f90 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedf0089ce0 con 0x7fedf0051f90 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7feddc0031a0 con 0x7fedf0051f90 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient(hunting): dump: 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:11.238 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 client.?.objecter ms_handle_connect 0x7fedf00523a0 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4250836577 0 0) 0x7fedf0089ce0 con 0x7fedf0051f90 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 >> v1:10.20.193.119:6789/0 conn(0x7fedf00523a0 legacy=0x7fedf0111650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 >> v1:10.20.193.104:6789/0 conn(0x7fedf008f990 legacy=0x7fedf01a16e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:10:11.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient: _finish_hunting 0 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 monclient: found mon.c 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf00878b0 con 0x7fedf0051f90 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient: _finish_auth 0 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient: _check_auth_tickets 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 5 monclient: authenticate success, global_id 27602 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient: _renew_subs 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 1 -- 10.20.193.104:0/196561915 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fedf012a9c0 con 0x7fedf0051f90 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 client.27602.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:11.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient: _renew_subs 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 1 -- 10.20.193.104:0/196561915 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fedf0121bc0 con 0x7fedf0051f90 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 1 librados: init done 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feddc003a00 con 0x7fedf0051f90 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7feddc003c30 con 0x7fedf0051f90 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 monclient: dump: 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:11.241 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedee7fc640 4 set_mon_vals no callback set 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedf6455640 1 -- 10.20.193.104:0/196561915 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf0061860 con 0x7fedf0051f90 2026-02-13T08:10:11.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7feddc003dd0 con 0x7fedf0051f90 2026-02-13T08:10:11.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(211..211 src has 1..211) ==== 5425+0+0 (unknown 1003589350 0 0) 0x7feddc04aa50 con 0x7fedf0051f90 2026-02-13T08:10:11.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 client.27602.objecter ms_dispatch2 0x7fedf0000ba0 osd_map(211..211 src has 1..211) 2026-02-13T08:10:11.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 3 client.27602.objecter handle_osd_map got epochs [211,211] > 0 2026-02-13T08:10:11.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 3 client.27602.objecter handle_osd_map decoding full epoch 211 2026-02-13T08:10:11.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 20 client.27602.objecter dump_active .. 0 homeless 2026-02-13T08:10:11.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedef7fe640 10 monclient: get_auth_request con 0x7fedc003b740 auth_method 0 2026-02-13T08:10:11.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.223+0000 7fedecff9640 10 client.27602.objecter ms_handle_connect 0x7fedc003b740 2026-02-13T08:10:11.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.227+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7feddc016d40 con 0x7fedf0051f90 2026-02-13T08:10:11.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.227+0000 7fedecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:11.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.227+0000 7fedecff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:11.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:10:11.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:10:11.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:11.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 1 -- 10.20.193.104:0/196561915 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fedf0129500 con 0x7fedf0051f90 2026-02-13T08:10:11.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedecff9640 1 -- 10.20.193.104:0/196561915 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1475 (unknown 254746657 0 3280585921) 0x7feddc016640 con 0x7fedf0051f90 2026-02-13T08:10:11.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedecff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:10:11.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedecff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:11.344 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":38,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:10:11.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 10 librados: watch_flush enter 2026-02-13T08:10:11.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 10 librados: watch_flush exit 2026-02-13T08:10:11.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 20 client.27602.objecter shutdown clearing up homeless session... 2026-02-13T08:10:11.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 10 client.27602.objecter successfully canceled tick 2026-02-13T08:10:11.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 1 -- 10.20.193.104:0/196561915 >> v1:10.20.193.119:6812/276487904 conn(0x7fedc003b740 legacy=0x7fedc005bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:11.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 10 monclient: shutdown 2026-02-13T08:10:11.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:11.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 1 -- 10.20.193.104:0/196561915 >> v1:10.20.193.104:6790/0 conn(0x7fedf0051f90 legacy=0x7fedf0110f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:11.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 1 -- 10.20.193.104:0/196561915 shutdown_connections 2026-02-13T08:10:11.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 1 -- 10.20.193.104:0/196561915 >> 10.20.193.104:0/196561915 conn(0x7fedf008d1c0 msgr2=0x7fedf00893e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:11.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 1 -- 10.20.193.104:0/196561915 shutdown_connections 2026-02-13T08:10:11.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 1 -- 10.20.193.104:0/196561915 wait complete. 2026-02-13T08:10:11.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:11.343+0000 7fedf6455640 1 librados: shutdown 2026-02-13T08:10:14.353 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:10:14.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 10 monclient: get_monmap_and_config 2026-02-13T08:10:14.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 10 monclient: build_initial_monmap 2026-02-13T08:10:14.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 10 monclient: monmap: 2026-02-13T08:10:14.421 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:14.421 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:14.421 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:14.423296+0000 2026-02-13T08:10:14.421 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:14.423296+0000 2026-02-13T08:10:14.422 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:14.422 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:14.422 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:14.422 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:14.422 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:14.422 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:14.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 1 Processor -- start 2026-02-13T08:10:14.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 1 -- start start 2026-02-13T08:10:14.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 10 monclient: init 2026-02-13T08:10:14.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:14.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:10:14.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 10 monclient(hunting): picked mon.noname-a con 0x7f415808f310 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:14.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 10 monclient(hunting): picked mon.noname-c con 0x7f41581607f0 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:14.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 10 monclient(hunting): picked mon.noname-b con 0x7f41581822f0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:14.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415808c390 con 0x7f415808f310 2026-02-13T08:10:14.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415805c6d0 con 0x7f41581607f0 2026-02-13T08:10:14.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415808ab80 con 0x7f41581822f0 2026-02-13T08:10:14.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:14.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f415c826640 10 monclient(hunting): authenticate will time out at 720.011990s 2026-02-13T08:10:14.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.419+0000 7f4156575640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f415808f6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:14.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.423+0000 7f4156d76640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f41581822f0 0x7f41581a26d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47560/0 (socket says 10.20.193.104:47560) 2026-02-13T08:10:14.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.423+0000 7f4156d76640 1 -- 10.20.193.104:0/2740868828 learned_addr learned my addr 10.20.193.104:0/2740868828 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:14.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:14.627+0000 7f4156575640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f415808f6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:15.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:15.031+0000 7f4156575640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f415808f6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:15.834 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:15.834+0000 7f4156575640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f415808f6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:17.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 10 monclient(hunting): tick 2026-02-13T08:10:17.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T08:10:17.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 1 monclient(hunting): continuing hunt 2026-02-13T08:10:17.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T08:10:17.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6790/0 conn(0x7f41581822f0 legacy=0x7f41581a26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:17.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.119:6789/0 conn(0x7f41581607f0 legacy=0x7f4158180bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:17.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f415808f6e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:10:17.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:10:17.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f41581607f0 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:17.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f41581822f0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:17.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f415808f310 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:17.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415808ae60 con 0x7f415808f310 2026-02-13T08:10:17.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4134068ef0 con 0x7f41581607f0 2026-02-13T08:10:17.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413406a190 con 0x7f41581822f0 2026-02-13T08:10:17.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f413ffff640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:17.424 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.423+0000 7f4156d76640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f41340667a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:17.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:17.623+0000 7f4156d76640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f41340667a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:18.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:18.023+0000 7f4156d76640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f41340667a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:18.823 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:18.823+0000 7f4156d76640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f41340667a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:20.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 10 monclient(hunting): tick 2026-02-13T08:10:20.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 10 monclient(hunting): _check_auth_tickets 2026-02-13T08:10:20.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 1 monclient(hunting): continuing hunt 2026-02-13T08:10:20.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T08:10:20.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6790/0 conn(0x7f41581822f0 legacy=0x7f4134044fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:20.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.119:6789/0 conn(0x7f41581607f0 legacy=0x7f41340237d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:20.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f41340667a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:10:20.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:10:20.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f41340691c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:20.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f41581822f0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:20.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f415808f310 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:20.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413406b490 con 0x7f415808f310 2026-02-13T08:10:20.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415808ae60 con 0x7f41340691c0 2026-02-13T08:10:20.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 1 -- 10.20.193.104:0/2740868828 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4134024f10 con 0x7f41581822f0 2026-02-13T08:10:20.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f413ffff640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:20.423 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.423+0000 7f4156d76640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f41340667a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:20.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:20.623+0000 7f4156d76640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f41340667a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:21.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:21.023+0000 7f4156d76640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f41340667a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:21.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:21.827+0000 7f4156d76640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f41340667a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:22.829 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 1 -- 10.20.193.104:0/2740868828 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1329521869 0 0) 0x7f4134024f10 con 0x7f41581822f0 2026-02-13T08:10:22.830 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient(hunting): _negotiate 2026-02-13T08:10:22.830 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:22.830 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:22.830 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient(hunting): my global_id is 27605 2026-02-13T08:10:22.830 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 1 -- 10.20.193.104:0/2740868828 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4144003620 con 0x7f41581822f0 2026-02-13T08:10:22.830 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 1 -- 10.20.193.104:0/2740868828 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 425124326 0 0) 0x7f4144003620 con 0x7f41581822f0 2026-02-13T08:10:22.830 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.119:6789/0 conn(0x7f41340691c0 legacy=0x7f4134069590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:22.830 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6789/0 conn(0x7f415808f310 legacy=0x7f41340667a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient: _finish_hunting 0 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 1 monclient: found mon.noname-b 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 1 -- 10.20.193.104:0/2740868828 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41340260f0 con 0x7f41581822f0 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient: _finish_auth 0 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient: _check_auth_tickets 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 1 -- 10.20.193.104:0/2740868828 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4140002d60 con 0x7f41581822f0 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 5 monclient: authenticate success, global_id 27605 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:22.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient: dump: 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:22.832 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 1 -- 10.20.193.104:0/2740868828 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4140002fa0 con 0x7f41581822f0 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 1 -- 10.20.193.104:0/2740868828 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f41400033e0 con 0x7f41581822f0 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4155573640 10 monclient: dump: 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:22.833 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 4 set_mon_vals no callback set 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient: shutdown 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 -- 10.20.193.104:0/2740868828 >> v1:10.20.193.104:6790/0 conn(0x7f41581822f0 legacy=0x7f4134023790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 -- 10.20.193.104:0/2740868828 shutdown_connections 2026-02-13T08:10:22.834 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 -- 10.20.193.104:0/2740868828 >> 10.20.193.104:0/2740868828 conn(0x7f4158090750 msgr2=0x7f415808cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 -- 10.20.193.104:0/2740868828 shutdown_connections 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 -- 10.20.193.104:0/2740868828 wait complete. 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient: build_initial_monmap 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient: monmap: 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:22.835 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 librados: starting msgr at 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 librados: starting objecter 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 Processor -- start 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 -- start start 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 librados: setting wanted keys 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 librados: calling monclient init 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient: init 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient(hunting): picked mon.noname-c con 0x7f41340691c0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:22.836 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient(hunting): picked mon.noname-b con 0x7f415808f310 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient(hunting): picked mon.noname-a con 0x7f41581822f0 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41581627b0 con 0x7f41581822f0 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f415805e0d0 con 0x7f415808f310 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4158161900 con 0x7f41340691c0 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f415c826640 10 monclient(hunting): authenticate will time out at 728.419568s 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4156d76640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7f41581822f0 legacy=0x7f4158150550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4156575640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f41340691c0 0x7f415817b190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57576/0 (socket says 10.20.193.104:57576) 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f4156575640 1 -- 10.20.193.104:0/1210331600 learned_addr learned my addr 10.20.193.104:0/1210331600 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f413effd640 10 client.?.objecter ms_handle_connect 0x7f41340691c0 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f413effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:22.837 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f413effd640 10 client.?.objecter ms_handle_connect 0x7f415808f310 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f413effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4131908530 0 0) 0x7f4158161900 con 0x7f41340691c0 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f413effd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f413effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f413effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f413effd640 10 monclient(hunting): my global_id is 27608 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.827+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4124003620 con 0x7f41340691c0 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1099702519 0 0) 0x7f4124003620 con 0x7f41340691c0 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4158161900 con 0x7f41340691c0 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f414c0042e0 con 0x7f41340691c0 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:22.838 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient(hunting): dump: 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:22.839 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:22.842 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931827745 0 0) 0x7f415805e0d0 con 0x7f415808f310 2026-02-13T08:10:22.842 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:22.842 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:22.842 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient(hunting): my global_id is 74485 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4124003620 con 0x7f415808f310 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 265086202 0 0) 0x7f4124003620 con 0x7f415808f310 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f415805e0d0 con 0x7f415808f310 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f41400032f0 con 0x7f415808f310 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient(hunting): dump: 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:22.843 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:22.844 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:22.844 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:22.844 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:22.844 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:22.844 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:22.844 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:22.844 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3853212070 0 0) 0x7f415805e0d0 con 0x7f415808f310 2026-02-13T08:10:22.844 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 >> v1:10.20.193.104:6790/0 conn(0x7f41340691c0 legacy=0x7f415817b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:22.844 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 >> v1:10.20.193.104:6789/0 conn(0x7f41581822f0 legacy=0x7f4158150550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:10:22.844 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient: _finish_hunting 0 2026-02-13T08:10:22.844 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 monclient: found mon.b 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4158164270 con 0x7f415808f310 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient: _finish_auth 0 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient: _check_auth_tickets 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 5 monclient: authenticate success, global_id 74485 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 10 monclient: _renew_subs 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 1 -- 10.20.193.104:0/1210331600 --> v1:10.20.193.119:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f415817b8a0 con 0x7f415808f310 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 10 client.74485.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 10 monclient: _renew_subs 2026-02-13T08:10:22.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 1 -- 10.20.193.104:0/1210331600 --> v1:10.20.193.119:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f41581614d0 con 0x7f415808f310 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 1 librados: init done 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.1 v1:10.20.193.119:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4140002fa0 con 0x7f415808f310 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.1 v1:10.20.193.119:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f41400038e0 con 0x7f415808f310 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f4154d72640 4 set_mon_vals no callback set 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f413effd640 10 monclient: dump: 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:22.846 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.831+0000 7f415c826640 1 -- 10.20.193.104:0/1210331600 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4158061860 con 0x7f415808f310 2026-02-13T08:10:22.847 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.835+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.1 v1:10.20.193.119:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f4140003a80 con 0x7f415808f310 2026-02-13T08:10:22.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.835+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.1 v1:10.20.193.119:6789/0 8 ==== osd_map(211..211 src has 1..211) ==== 5425+0+0 (unknown 1003589350 0 0) 0x7f4140049480 con 0x7f415808f310 2026-02-13T08:10:22.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.835+0000 7f413effd640 10 client.74485.objecter ms_dispatch2 0x7f4158000ba0 osd_map(211..211 src has 1..211) 2026-02-13T08:10:22.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.835+0000 7f413effd640 3 client.74485.objecter handle_osd_map got epochs [211,211] > 0 2026-02-13T08:10:22.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.835+0000 7f413effd640 3 client.74485.objecter handle_osd_map decoding full epoch 211 2026-02-13T08:10:22.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.835+0000 7f413effd640 20 client.74485.objecter dump_active .. 0 homeless 2026-02-13T08:10:22.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.835+0000 7f4156575640 10 monclient: get_auth_request con 0x7f412403b7f0 auth_method 0 2026-02-13T08:10:22.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.835+0000 7f413effd640 10 client.74485.objecter ms_handle_connect 0x7f412403b7f0 2026-02-13T08:10:22.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.839+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.1 v1:10.20.193.119:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f41400157d0 con 0x7f415808f310 2026-02-13T08:10:22.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.839+0000 7f413effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:22.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.839+0000 7f413effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:22.954 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:10:22.954 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:10:22.954 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 10 monclient: _send_mon_message to mon.b at v1:10.20.193.119:6789/0 2026-02-13T08:10:22.954 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 1 -- 10.20.193.104:0/1210331600 --> v1:10.20.193.119:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4158056cb0 con 0x7f415808f310 2026-02-13T08:10:22.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f413effd640 1 -- 10.20.193.104:0/1210331600 <== mon.1 v1:10.20.193.119:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1469 (unknown 254746657 0 695624067) 0x7f4158056cb0 con 0x7f415808f310 2026-02-13T08:10:22.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f413effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:10:22.955 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f413effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:22.955 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":40,"quorum":[1,2],"quorum_names":["b","c"],"quorum_leader_name":"b","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:10:22.956 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 10 librados: watch_flush enter 2026-02-13T08:10:22.956 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 10 librados: watch_flush exit 2026-02-13T08:10:22.957 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 20 client.74485.objecter shutdown clearing up homeless session... 2026-02-13T08:10:22.957 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 10 client.74485.objecter successfully canceled tick 2026-02-13T08:10:22.957 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 1 -- 10.20.193.104:0/1210331600 >> v1:10.20.193.119:6812/276487904 conn(0x7f412403b7f0 legacy=0x7f412405bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:22.957 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 10 monclient: shutdown 2026-02-13T08:10:22.957 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:22.957 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 1 -- 10.20.193.104:0/1210331600 >> v1:10.20.193.119:6789/0 conn(0x7f415808f310 legacy=0x7f415814ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:22.957 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 1 -- 10.20.193.104:0/1210331600 shutdown_connections 2026-02-13T08:10:22.957 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 1 -- 10.20.193.104:0/1210331600 >> 10.20.193.104:0/1210331600 conn(0x7f4158090750 msgr2=0x7f4158085e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:22.957 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 1 -- 10.20.193.104:0/1210331600 shutdown_connections 2026-02-13T08:10:22.957 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 1 -- 10.20.193.104:0/1210331600 wait complete. 2026-02-13T08:10:22.957 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:22.955+0000 7f415c826640 1 librados: shutdown 2026-02-13T08:10:22.966 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T08:10:22.966 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon c 2026-02-13T08:10:22.966 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T08:10:23.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.035+0000 7fc55ce4c640 10 monclient: get_monmap_and_config 2026-02-13T08:10:23.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.035+0000 7fc55ce4c640 10 monclient: build_initial_monmap 2026-02-13T08:10:23.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.035+0000 7fc55ce4c640 10 monclient: monmap: 2026-02-13T08:10:23.036 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:23.036 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.036 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:23.038998+0000 2026-02-13T08:10:23.036 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:23.038998+0000 2026-02-13T08:10:23.037 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:23.037 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.037 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:23.037 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:23.037 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:23.037 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.046 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.035+0000 7fc55ce4c640 1 Processor -- start 2026-02-13T08:10:23.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.035+0000 7fc55ce4c640 1 -- start start 2026-02-13T08:10:23.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.035+0000 7fc55ce4c640 10 monclient: init 2026-02-13T08:10:23.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:23.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:10:23.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient(hunting): picked mon.noname-a con 0x7fc558091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:23.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient(hunting): picked mon.noname-c con 0x7fc55813f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:23.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient(hunting): picked mon.noname-b con 0x7fc55813fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:23.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55808e5f0 con 0x7fc558091740 2026-02-13T08:10:23.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55808e8d0 con 0x7fc55813f870 2026-02-13T08:10:23.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55808ebb0 con 0x7fc55813fcd0 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient(hunting): authenticate will time out at 728.628129s 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc556575640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7fc558091740 legacy=0x7fc55813f160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc556d76640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fc55813fcd0 0x7fc5581a1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57588/0 (socket says 10.20.193.104:57588) 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc556d76640 1 -- 10.20.193.104:0/3152497493 learned_addr learned my addr 10.20.193.104:0/3152497493 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 1 -- 10.20.193.104:0/3152497493 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2831329517 0 0) 0x7fc55808ebb0 con 0x7fc55813fcd0 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient(hunting): _negotiate 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient(hunting): my global_id is 27611 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 1 -- 10.20.193.104:0/3152497493 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc544003620 con 0x7fc55813fcd0 2026-02-13T08:10:23.048 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 1 -- 10.20.193.104:0/3152497493 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3180110068 0 0) 0x7fc544003620 con 0x7fc55813fcd0 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 1 -- 10.20.193.104:0/3152497493 >> v1:10.20.193.119:6789/0 conn(0x7fc55813f870 legacy=0x7fc558180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 1 -- 10.20.193.104:0/3152497493 >> v1:10.20.193.104:6789/0 conn(0x7fc558091740 legacy=0x7fc55813f160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient: _finish_hunting 0 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 1 monclient: found mon.noname-b 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 1 -- 10.20.193.104:0/3152497493 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc558091b10 con 0x7fc55813fcd0 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient: _finish_auth 0 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient: _check_auth_tickets 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 1 -- 10.20.193.104:0/3152497493 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc548003180 con 0x7fc55813fcd0 2026-02-13T08:10:23.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient: dump: 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.050 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 5 monclient: authenticate success, global_id 27611 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 1 -- 10.20.193.104:0/3152497493 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc548003410 con 0x7fc55813fcd0 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 1 -- 10.20.193.104:0/3152497493 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc548003850 con 0x7fc55813fcd0 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555573640 10 monclient: dump: 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.051 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 4 set_mon_vals no callback set 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: shutdown 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- 10.20.193.104:0/3152497493 >> v1:10.20.193.104:6790/0 conn(0x7fc55813fcd0 legacy=0x7fc5581a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- 10.20.193.104:0/3152497493 shutdown_connections 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- 10.20.193.104:0/3152497493 >> 10.20.193.104:0/3152497493 conn(0x7fc558090810 msgr2=0x7fc558090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- 10.20.193.104:0/3152497493 shutdown_connections 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- 10.20.193.104:0/3152497493 wait complete. 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: build_initial_monmap 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: monmap: 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.053 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 librados: starting msgr at 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 librados: starting objecter 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 Processor -- start 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- start start 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 librados: setting wanted keys 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 librados: calling monclient init 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: init 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:23.054 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient(hunting): picked mon.noname-b con 0x7fc558091740 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient(hunting): picked mon.noname-a con 0x7fc55813f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient(hunting): picked mon.noname-c con 0x7fc55813fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55812fbf0 con 0x7fc55813f870 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55812ccc0 con 0x7fc558091740 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc55808ab30 con 0x7fc55813fcd0 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient(hunting): authenticate will time out at 728.630497s 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc555d74640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7fc55813f870 legacy=0x7fc55812c5b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc556d76640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fc55813fcd0 0x7fc5581917a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57598/0 (socket says 10.20.193.104:57598) 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc556d76640 1 -- 10.20.193.104:0/2875104797 learned_addr learned my addr 10.20.193.104:0/2875104797 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:23.055 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 client.?.objecter ms_handle_connect 0x7fc55813fcd0 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2189390789 0 0) 0x7fc55808ab30 con 0x7fc55813fcd0 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): my global_id is 27614 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc524003620 con 0x7fc55813fcd0 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 client.?.objecter ms_handle_connect 0x7fc558091740 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2977314143 0 0) 0x7fc524003620 con 0x7fc55813fcd0 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc55808ab30 con 0x7fc55813fcd0 2026-02-13T08:10:23.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc5480035c0 con 0x7fc55813fcd0 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): dump: 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.057 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007028741 0 0) 0x7fc55812ccc0 con 0x7fc558091740 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient(hunting): my global_id is 74491 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc524003620 con 0x7fc558091740 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4270461856 0 0) 0x7fc55808ab30 con 0x7fc55813fcd0 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 >> v1:10.20.193.119:6789/0 conn(0x7fc558091740 legacy=0x7fc55812bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 >> v1:10.20.193.104:6789/0 conn(0x7fc55813f870 legacy=0x7fc55812c5b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:10:23.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient: _finish_hunting 0 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 monclient: found mon.c 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55812ed80 con 0x7fc55813fcd0 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient: _finish_auth 0 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient: _check_auth_tickets 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 5 monclient: authenticate success, global_id 27614 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: _renew_subs 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc55812d890 con 0x7fc55813fcd0 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 client.27614.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:23.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: _renew_subs 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc55812e650 con 0x7fc55813fcd0 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 librados: init done 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5480033c0 con 0x7fc55813fcd0 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc548005210 con 0x7fc55813fcd0 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 monclient: dump: 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.060 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.061 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.061 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.061 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.061 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.061 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.061 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.061 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc554d72640 4 set_mon_vals no callback set 2026-02-13T08:10:23.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:23.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc55ce4c640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc558061860 con 0x7fc5580889c0 2026-02-13T08:10:23.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 client.27614.objecter ms_handle_connect 0x7fc5580889c0 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 10 client.27614.objecter resend_mon_ops 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.039+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fc548011220 con 0x7fc55813fcd0 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1337419460 0 0) 0x7fc558061860 con 0x7fc5580889c0 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient(hunting): my global_id is 27617 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc55808ab30 con 0x7fc5580889c0 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(212..212 src has 1..212) ==== 5531+0+0 (unknown 1117737799 0 0) 0x7fc54804ad20 con 0x7fc55813fcd0 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 client.27614.objecter ms_dispatch2 0x7fc558000ba0 osd_map(212..212 src has 1..212) 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 3 client.27614.objecter handle_osd_map got epochs [212,212] > 0 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 3 client.27614.objecter handle_osd_map decoding full epoch 212 2026-02-13T08:10:23.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 20 client.27614.objecter dump_active .. 0 homeless 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 464030310 0 0) 0x7fc55808ab30 con 0x7fc5580889c0 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc558061860 con 0x7fc5580889c0 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc54c004060 con 0x7fc5580889c0 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient: dump: 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.063 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc555d74640 10 monclient: get_auth_request con 0x7fc52403b780 auth_method 0 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2974633676 0 0) 0x7fc558061860 con 0x7fc5580889c0 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc55804d110 con 0x7fc5580889c0 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 client.27614.objecter ms_handle_connect 0x7fc52403b780 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7fc54c004340 con 0x7fc5580889c0 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 >> v1:10.20.193.104:6790/0 conn(0x7fc5580889c0 legacy=0x7fc55804ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 >> v1:10.20.193.104:6790/0 conn(0x7fc5580889c0 legacy=0x7fc55804ca00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc55ce4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc55ce4c640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc55813f530 con 0x7fc558088d90 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 client.27614.objecter ms_handle_connect 0x7fc558088d90 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 client.27614.objecter resend_mon_ops 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243061679 0 0) 0x7fc55813f530 con 0x7fc558088d90 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient(hunting): _negotiate 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 10 monclient(hunting): my global_id is 27620 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.043+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc558061860 con 0x7fc558088d90 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2234366955 0 0) 0x7fc558061860 con 0x7fc558088d90 2026-02-13T08:10:23.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc55813f530 con 0x7fc558088d90 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc54c0049e0 con 0x7fc558088d90 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 10 monclient: dump: 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.066 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.067 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3155378626 0 0) 0x7fc55813f530 con 0x7fc558088d90 2026-02-13T08:10:23.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 --> v1:10.20.193.104:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc558197780 con 0x7fc558088d90 2026-02-13T08:10:23.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4481 (unknown 0 0 3319384681) 0x7fc54c004800 con 0x7fc558088d90 2026-02-13T08:10:23.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:10:23.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:23.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 >> v1:10.20.193.104:6790/0 conn(0x7fc558088d90 legacy=0x7fc558193ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc53effd640 1 -- 10.20.193.104:0/2875104797 >> v1:10.20.193.104:6790/0 conn(0x7fc558088d90 legacy=0x7fc558193ed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:23.068 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:10:23.068 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:10:23.068 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:10:23.068 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:10:23.068 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 40, 2026-02-13T08:10:23.068 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 292454, 2026-02-13T08:10:23.068 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:10:23.068 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:10:23.068 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:10:23.068 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:23.069 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:23.070 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:10:23.071 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:10:23.072 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:23.073 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.074 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:23.075 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.076 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.077 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: "num": 4 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.078 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:23.079 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:10:23.079 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.079 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:23.079 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:23.079 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:23.079 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.079 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.079 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.079 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:10:23.079 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 10 librados: watch_flush enter 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 10 librados: watch_flush exit 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 20 client.27614.objecter shutdown clearing up homeless session... 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 10 client.27614.objecter successfully canceled tick 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 1 -- 10.20.193.104:0/2875104797 >> v1:10.20.193.119:6812/276487904 conn(0x7fc52403b780 legacy=0x7fc52405bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 10 monclient: shutdown 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 1 -- 10.20.193.104:0/2875104797 >> v1:10.20.193.104:6790/0 conn(0x7fc55813fcd0 legacy=0x7fc5581917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc556d76640 1 -- 10.20.193.104:0/2875104797 reap_dead start 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc556d76640 1 -- 10.20.193.104:0/2875104797 reap_dead start 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 1 -- 10.20.193.104:0/2875104797 shutdown_connections 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 1 -- 10.20.193.104:0/2875104797 >> 10.20.193.104:0/2875104797 conn(0x7fc558090810 msgr2=0x7fc558057f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 1 -- 10.20.193.104:0/2875104797 shutdown_connections 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 1 -- 10.20.193.104:0/2875104797 wait complete. 2026-02-13T08:10:23.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.047+0000 7fc55ce4c640 1 librados: shutdown 2026-02-13T08:10:23.082 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T08:10:23.082 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T08:10:23.082 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T08:10:23.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient: get_monmap_and_config 2026-02-13T08:10:23.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient: build_initial_monmap 2026-02-13T08:10:23.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient: monmap: 2026-02-13T08:10:23.154 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:23.154 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.154 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:10:23.154385+0000 2026-02-13T08:10:23.154 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:10:23.154385+0000 2026-02-13T08:10:23.154 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 1 Processor -- start 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 1 -- start start 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient: init 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient(hunting): picked mon.noname-b con 0x7f19cc13f690 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient(hunting): picked mon.noname-c con 0x7f19cc08d940 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient(hunting): picked mon.noname-a con 0x7f19cc08dd60 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19cc08b890 con 0x7f19cc08dd60 2026-02-13T08:10:23.155 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19cc08bb70 con 0x7f19cc08d940 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19cc089f10 con 0x7f19cc13f690 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient(hunting): authenticate will time out at 728.743109s 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d212c640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7f19cc08dd60 legacy=0x7f19cc1a1c70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d192b640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f19cc13f690 0x7f19cc08d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57624/0 (socket says 10.20.193.104:57624) 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d192b640 1 -- 10.20.193.104:0/1026748414 learned_addr learned my addr 10.20.193.104:0/1026748414 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 1 -- 10.20.193.104:0/1026748414 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279180072 0 0) 0x7f19cc089f10 con 0x7f19cc13f690 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient(hunting): _negotiate 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient(hunting): my global_id is 27623 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 1 -- 10.20.193.104:0/1026748414 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19b4003620 con 0x7f19cc13f690 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 1 -- 10.20.193.104:0/1026748414 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3994381163 0 0) 0x7f19b4003620 con 0x7f19cc13f690 2026-02-13T08:10:23.156 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 1 -- 10.20.193.104:0/1026748414 >> v1:10.20.193.119:6789/0 conn(0x7f19cc08d940 legacy=0x7f19cc180540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 1 -- 10.20.193.104:0/1026748414 >> v1:10.20.193.104:6789/0 conn(0x7f19cc08dd60 legacy=0x7f19cc1a1c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient: _finish_hunting 0 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 1 monclient: found mon.noname-b 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 1 -- 10.20.193.104:0/1026748414 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc1a63c0 con 0x7f19cc13f690 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient: _finish_auth 0 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient: _check_auth_tickets 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 1 -- 10.20.193.104:0/1026748414 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f19bc002e00 con 0x7f19cc13f690 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient: dump: 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.157 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 5 monclient: authenticate success, global_id 27623 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 1 -- 10.20.193.104:0/1026748414 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f19bc003080 con 0x7f19cc13f690 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 1 -- 10.20.193.104:0/1026748414 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f19bc0034c0 con 0x7f19cc13f690 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:23.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d0929640 10 monclient: dump: 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 10 monclient: get_monmap_and_config success 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.151+0000 7f19d3bb6640 4 set_mon_vals no callback set 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient: shutdown 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:23.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- 10.20.193.104:0/1026748414 >> v1:10.20.193.104:6790/0 conn(0x7f19cc13f690 legacy=0x7f19cc08d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- 10.20.193.104:0/1026748414 shutdown_connections 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- 10.20.193.104:0/1026748414 >> 10.20.193.104:0/1026748414 conn(0x7f19cc051a50 msgr2=0x7f19cc051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- 10.20.193.104:0/1026748414 shutdown_connections 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- 10.20.193.104:0/1026748414 wait complete. 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient: build_initial_monmap 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient: monmap: 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:10:23.160 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 librados: starting msgr at 2026-02-13T08:10:23.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 librados: starting objecter 2026-02-13T08:10:23.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 Processor -- start 2026-02-13T08:10:23.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- start start 2026-02-13T08:10:23.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 librados: setting wanted keys 2026-02-13T08:10:23.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 librados: calling monclient init 2026-02-13T08:10:23.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient: init 2026-02-13T08:10:23.166 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient: _reopen_session rank -1 2026-02-13T08:10:23.166 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:10:23.166 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient(hunting): picked mon.noname-a con 0x7f19cc08d940 addr v1:10.20.193.104:6789/0 2026-02-13T08:10:23.166 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient(hunting): picked mon.noname-c con 0x7f19cc08dd60 addr v1:10.20.193.104:6790/0 2026-02-13T08:10:23.166 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient(hunting): picked mon.noname-b con 0x7f19cc13f690 addr v1:10.20.193.119:6789/0 2026-02-13T08:10:23.166 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d192b640 1 -- >> v1:10.20.193.104:6789/0 conn(0x7f19cc08d940 legacy=0x7f19cc14c750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.104:6789/0 2026-02-13T08:10:23.166 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19cc1286f0 con 0x7f19cc08d940 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19cc129250 con 0x7f19cc13f690 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19cc12a1b0 con 0x7f19cc08dd60 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient(hunting): _renew_subs 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient(hunting): authenticate will time out at 728.745482s 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d112a640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f19cc08dd60 0x7f19cc13c080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57634/0 (socket says 10.20.193.104:57634) 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d112a640 1 -- 10.20.193.104:0/3473890124 learned_addr learned my addr 10.20.193.104:0/3473890124 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 client.?.objecter ms_handle_connect 0x7f19cc08dd60 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3459805560 0 0) 0x7f19cc12a1b0 con 0x7f19cc08dd60 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): my global_id is 27626 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f199c003620 con 0x7f19cc08dd60 2026-02-13T08:10:23.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3454816718 0 0) 0x7f199c003620 con 0x7f19cc08dd60 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19cc12a1b0 con 0x7f19cc08dd60 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f19c00031a0 con 0x7f19cc08dd60 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): dump: 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 client.?.objecter ms_handle_connect 0x7f19cc13f690 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2254006885 0 0) 0x7f19cc12a1b0 con 0x7f19cc08dd60 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 >> v1:10.20.193.119:6789/0 conn(0x7f19cc13f690 legacy=0x7f19cc18eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 >> v1:10.20.193.104:6789/0 conn(0x7f19cc08d940 legacy=0x7f19cc14c750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: _finish_hunting 0 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 monclient: found mon.c 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19cc12a490 con 0x7f19cc08dd60 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: _finish_auth 0 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: _check_auth_tickets 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 5 monclient: authenticate success, global_id 27626 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient: _renew_subs 2026-02-13T08:10:23.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f19cc13ce10 con 0x7f19cc08dd60 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 client.27626.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient: _renew_subs 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f19cc13ca20 con 0x7f19cc08dd60 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 librados: init done 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f19c00039c0 con 0x7f19cc08dd60 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f19c0003bf0 con 0x7f19cc08dd60 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: dump: 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.170 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19bbfff640 4 set_mon_vals no callback set 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d3bb6640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f19cc061860 con 0x7f19cc1a35a0 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f19c0003d90 con 0x7f19cc08dd60 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(212..212 src has 1..212) ==== 5531+0+0 (unknown 1117737799 0 0) 0x7f19c004aa70 con 0x7f19cc08dd60 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 client.27626.objecter ms_dispatch2 0x7f19cc000ba0 osd_map(212..212 src has 1..212) 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 3 client.27626.objecter handle_osd_map got epochs [212,212] > 0 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 3 client.27626.objecter handle_osd_map decoding full epoch 212 2026-02-13T08:10:23.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 20 client.27626.objecter dump_active .. 0 homeless 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 client.27626.objecter ms_handle_connect 0x7f19cc1a35a0 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 client.27626.objecter resend_mon_ops 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19d212c640 10 monclient: get_auth_request con 0x7f199c03b770 auth_method 0 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 13456235 0 0) 0x7f19cc061860 con 0x7f19cc1a35a0 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient(hunting): my global_id is 74497 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19cc12a1b0 con 0x7f19cc1a35a0 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3656732816 0 0) 0x7f19cc12a1b0 con 0x7f19cc1a35a0 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19cc061860 con 0x7f19cc1a35a0 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f19bc002e00 con 0x7f19cc1a35a0 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: dump: 2026-02-13T08:10:23.172 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 464656758 0 0) 0x7f19cc061860 con 0x7f19cc1a35a0 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.119:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19cc086f40 con 0x7f19cc1a35a0 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 client.27626.objecter ms_handle_connect 0x7f199c03b770 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f19bc003390 con 0x7f19cc1a35a0 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:10:23.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 >> v1:10.20.193.119:6789/0 conn(0x7f19cc1a35a0 legacy=0x7f19cc086830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.155+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 >> v1:10.20.193.119:6789/0 conn(0x7f19cc1a35a0 legacy=0x7f19cc086830 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19d3bb6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19d3bb6640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f19cc087630 con 0x7f19cc087230 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 10 client.27626.objecter ms_handle_connect 0x7f19cc087230 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 10 client.27626.objecter resend_mon_ops 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616727067 0 0) 0x7f19cc087630 con 0x7f19cc087230 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 10 monclient(hunting): my global_id is 74500 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19cc061860 con 0x7f19cc087230 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2273347264 0 0) 0x7f19cc061860 con 0x7f19cc087230 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19cc087630 con 0x7f19cc087230 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f19bc004be0 con 0x7f19cc087230 2026-02-13T08:10:23.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 10 monclient: dump: 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1578352815 0 0) 0x7f19cc087630 con 0x7f19cc087230 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 --> v1:10.20.193.119:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f19cc087800 con 0x7f19cc087230 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4316 (unknown 0 0 620714587) 0x7f19bc004be0 con 0x7f19cc087230 2026-02-13T08:10:23.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:10:23.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:10:23.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 >> v1:10.20.193.119:6789/0 conn(0x7f19cc087230 legacy=0x7f19cc191250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19ba7fc640 1 -- 10.20.193.104:0/3473890124 >> v1:10.20.193.119:6789/0 conn(0x7f19cc087230 legacy=0x7f19cc191250 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:10:23.176 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:10:23.176 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:10:23.176 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:10:23.176 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:10:23.176 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 40, 2026-02-13T08:10:23.176 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 160179, 2026-02-13T08:10:23.176 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:10:23.176 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:23.177 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:23.178 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:10:23.179 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:10:23.180 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:23.181 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:23.182 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:10:23.183 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:10:23.184 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:10:23.185 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:10:23.186 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:10:23.186 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:10:23.186 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:10:23.186 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:10:23.186 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:10:23.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19d3bb6640 10 librados: watch_flush enter 2026-02-13T08:10:23.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19d3bb6640 10 librados: watch_flush exit 2026-02-13T08:10:23.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19d3bb6640 20 client.27626.objecter shutdown clearing up homeless session... 2026-02-13T08:10:23.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.159+0000 7f19d3bb6640 10 client.27626.objecter successfully canceled tick 2026-02-13T08:10:23.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.163+0000 7f19d3bb6640 1 -- 10.20.193.104:0/3473890124 >> v1:10.20.193.119:6812/276487904 conn(0x7f199c03b770 legacy=0x7f199c05bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.163+0000 7f19d3bb6640 10 monclient: shutdown 2026-02-13T08:10:23.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.163+0000 7f19d3bb6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:10:23.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.163+0000 7f19d3bb6640 1 -- 10.20.193.104:0/3473890124 >> v1:10.20.193.104:6790/0 conn(0x7f19cc08dd60 legacy=0x7f19cc13c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:10:23.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.163+0000 7f19d212c640 1 -- 10.20.193.104:0/3473890124 reap_dead start 2026-02-13T08:10:23.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.163+0000 7f19d212c640 1 -- 10.20.193.104:0/3473890124 reap_dead start 2026-02-13T08:10:23.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.163+0000 7f19d3bb6640 1 -- 10.20.193.104:0/3473890124 shutdown_connections 2026-02-13T08:10:23.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.163+0000 7f19d3bb6640 1 -- 10.20.193.104:0/3473890124 >> 10.20.193.104:0/3473890124 conn(0x7f19cc051a50 msgr2=0x7f19cc05ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:10:23.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.163+0000 7f19d3bb6640 1 -- 10.20.193.104:0/3473890124 shutdown_connections 2026-02-13T08:10:23.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.163+0000 7f19d3bb6640 1 -- 10.20.193.104:0/3473890124 wait complete. 2026-02-13T08:10:23.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:10:23.163+0000 7f19d3bb6640 1 librados: shutdown 2026-02-13T08:10:23.188 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T08:10:23.188 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T08:10:34.668 INFO:tasks.workunit.client.0.trial119.stdout:_aio: [ OK ] LibRadosAio.CancelBeforeComplete (3006 ms) 2026-02-13T08:10:34.668 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAio.CancelAfterComplete 2026-02-13T08:10:34.668 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAio.CancelAfterComplete (3008 ms) 2026-02-13T08:10:34.668 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [----------] 29 tests from LibRadosAio (86976 ms total) 2026-02-13T08:10:34.668 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: 2026-02-13T08:10:34.668 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2026-02-13T08:10:34.668 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2026-02-13T08:10:34.668 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (38720 ms) 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6906 ms) 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7030 ms) 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6981 ms) 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7003 ms) 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (6988 ms) 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2026-02-13T08:10:34.669 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7016 ms) 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (6995 ms) 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6993 ms) 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7025 ms) 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (6984 ms) 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6999 ms) 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7008 ms) 2026-02-13T08:10:34.670 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2026-02-13T08:10:34.671 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (22461 ms) 2026-02-13T08:10:34.671 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2026-02-13T08:10:34.671 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (20912 ms) 2026-02-13T08:10:34.671 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2026-02-13T08:10:34.671 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7017 ms) 2026-02-13T08:10:34.671 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (173047 ms total) 2026-02-13T08:10:34.671 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: 2026-02-13T08:10:34.671 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [----------] Global test environment tear-down 2026-02-13T08:10:34.671 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [==========] 45 tests from 2 test suites ran. (260023 ms total) 2026-02-13T08:10:34.672 INFO:tasks.workunit.client.0.trial119.stdout: api_aio: [ PASSED ] 45 tests. 2026-02-13T08:11:24.662 INFO:tasks.workunit.client.0.trial119.stdout:o.RoundTripAppendPP (2900 ms) 2026-02-13T08:11:24.663 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2026-02-13T08:11:24.663 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3012 ms) 2026-02-13T08:11:24.663 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2026-02-13T08:11:24.663 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3017 ms) 2026-02-13T08:11:24.663 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2026-02-13T08:11:24.663 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (2977 ms) 2026-02-13T08:11:24.663 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2026-02-13T08:11:24.663 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: sending pool EIO time: 2026-02-13T08:08:43.268371+0000 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: ./src/test/librados/aio_cxx.cc:2430: Skipped 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: eio flag missed all ios that already completed 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag (8993 ms) 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3014 ms) 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (153617 ms total) 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3000 ms) 2026-02-13T08:11:24.664 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9000 ms) 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14989 ms) 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3012 ms) 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30003 ms total) 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3004 ms) 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3004 ms total) 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: 2026-02-13T08:11:24.665 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13986 ms) 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7010 ms) 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (6996 ms) 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (36378 ms) 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3012 ms) 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (6989 ms) 2026-02-13T08:11:24.666 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (7020 ms) 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (6988 ms) 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (6993 ms) 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7013 ms) 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (6994 ms) 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (6998 ms) 2026-02-13T08:11:24.667 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2026-02-13T08:11:53.189 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2026-02-13T08:11:53.190 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-13T08:11:53.190 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-13T08:11:53.192 INFO:tasks.ceph.mon.a:Started 2026-02-13T08:11:53.192 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T08:11:53.193 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:11:53.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 10 monclient: get_monmap_and_config 2026-02-13T08:11:53.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 10 monclient: build_initial_monmap 2026-02-13T08:11:53.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 10 monclient: monmap: 2026-02-13T08:11:53.252 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:53.253 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.253 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:11:53.250920+0000 2026-02-13T08:11:53.253 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:11:53.250920+0000 2026-02-13T08:11:53.253 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:53.253 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.253 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:53.253 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:11:53.253 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:11:53.253 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 1 Processor -- start 2026-02-13T08:11:53.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 1 -- start start 2026-02-13T08:11:53.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 10 monclient: init 2026-02-13T08:11:53.259 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 10 monclient(hunting): picked mon.noname-a con 0x7f161408e4b0 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 10 monclient(hunting): picked mon.noname-c con 0x7f161408ef90 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 10 monclient(hunting): picked mon.noname-b con 0x7f161417fe50 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1614089fa0 con 0x7f161408e4b0 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1614089760 con 0x7f161408ef90 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161408af90 con 0x7f161417fe50 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f161a02f640 10 monclient(hunting): authenticate will time out at 818.839672s 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f1613fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f161417fe50 0x7f16141a0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50814/0 (socket says 10.20.193.104:50814) 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.245+0000 7f1613fff640 1 -- 10.20.193.104:0/1904773954 learned_addr learned my addr 10.20.193.104:0/1904773954 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:53.260 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 1 -- 10.20.193.104:0/1904773954 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053105899 0 0) 0x7f1614089760 con 0x7f161408ef90 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient(hunting): my global_id is 74593 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 1 -- 10.20.193.104:0/1904773954 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15f8003620 con 0x7f161408ef90 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 1 -- 10.20.193.104:0/1904773954 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3899633541 0 0) 0x7f15f8003620 con 0x7f161408ef90 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 1 -- 10.20.193.104:0/1904773954 >> v1:10.20.193.104:6790/0 conn(0x7f161417fe50 legacy=0x7f16141a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 1 -- 10.20.193.104:0/1904773954 >> v1:10.20.193.104:6789/0 conn(0x7f161408e4b0 legacy=0x7f161408e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient: _finish_hunting 0 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 1 monclient: found mon.noname-c 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:53.261 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient: _send_mon_message to mon.noname-c at v1:10.20.193.119:6789/0 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 1 -- 10.20.193.104:0/1904773954 --> v1:10.20.193.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161408b270 con 0x7f161408ef90 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient: _finish_auth 0 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient: _check_auth_tickets 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 1 -- 10.20.193.104:0/1904773954 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1604002e00 con 0x7f161408ef90 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient: dump: 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.262 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 5 monclient: authenticate success, global_id 74593 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 1 -- 10.20.193.104:0/1904773954 <== mon.1 v1:10.20.193.119:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1604003080 con 0x7f161408ef90 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: get_monmap_and_config success 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 4 set_mon_vals no callback set 2026-02-13T08:11:53.263 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 1 -- 10.20.193.104:0/1904773954 <== mon.1 v1:10.20.193.119:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f16040034c0 con 0x7f161408ef90 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16127fc640 10 monclient: dump: 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.264 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: shutdown 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- 10.20.193.104:0/1904773954 >> v1:10.20.193.119:6789/0 conn(0x7f161408ef90 legacy=0x7f161417e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- 10.20.193.104:0/1904773954 shutdown_connections 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- 10.20.193.104:0/1904773954 >> 10.20.193.104:0/1904773954 conn(0x7f1614051e80 msgr2=0x7f161408c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- 10.20.193.104:0/1904773954 shutdown_connections 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- 10.20.193.104:0/1904773954 wait complete. 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: build_initial_monmap 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: monmap: 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:11:53.265 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 librados: starting msgr at 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 librados: starting objecter 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 Processor -- start 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- start start 2026-02-13T08:11:53.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 librados: setting wanted keys 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 librados: calling monclient init 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: init 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient(hunting): picked mon.noname-b con 0x7f161408e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient(hunting): picked mon.noname-a con 0x7f161408ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient(hunting): picked mon.noname-c con 0x7f161417fe50 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f161407f680 con 0x7f161408ef90 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1614080a40 con 0x7f161408e4b0 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1614086790 con 0x7f161417fe50 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:53.267 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient(hunting): authenticate will time out at 818.842016s 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f1613fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f161417fe50 0x7f1614170840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50816/0 (socket says 10.20.193.104:50816) 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f1613fff640 1 -- 10.20.193.104:0/1379549699 learned_addr learned my addr 10.20.193.104:0/1379549699 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 client.?.objecter ms_handle_connect 0x7f161417fe50 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 client.?.objecter ms_handle_connect 0x7f161408ef90 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 649238678 0 0) 0x7f1614086790 con 0x7f161417fe50 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient(hunting): my global_id is 27704 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15e4003620 con 0x7f161417fe50 2026-02-13T08:11:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 client.?.objecter ms_handle_connect 0x7f161408e4b0 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 345187066 0 0) 0x7f15e4003620 con 0x7f161417fe50 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1614086790 con 0x7f161417fe50 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1608003320 con 0x7f161417fe50 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient(hunting): dump: 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.269 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 604363314 0 0) 0x7f1614086790 con 0x7f161417fe50 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 >> v1:10.20.193.119:6789/0 conn(0x7f161408e4b0 legacy=0x7f1614086d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 >> v1:10.20.193.104:6789/0 conn(0x7f161408ef90 legacy=0x7f1614087440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient: _finish_hunting 0 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 monclient: found mon.c 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1614059fb0 con 0x7f161417fe50 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient: _finish_auth 0 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient: _check_auth_tickets 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 5 monclient: authenticate success, global_id 27704 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: _renew_subs 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- 10.20.193.104:0/1379549699 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1614088590 con 0x7f161417fe50 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 client.27704.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: _renew_subs 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- 10.20.193.104:0/1379549699 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f161407f410 con 0x7f161417fe50 2026-02-13T08:11:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 librados: init done 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1608004c60 con 0x7f161417fe50 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1608004ed0 con 0x7f161417fe50 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 monclient: dump: 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.272 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f1611ffb640 4 set_mon_vals no callback set 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f161a02f640 1 -- 10.20.193.104:0/1379549699 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1614061860 con 0x7f161417fe50 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f16080050f0 con 0x7f161417fe50 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(302..302 src has 1..302) ==== 5163+0+0 (unknown 1312576247 0 0) 0x7f160804ad90 con 0x7f161417fe50 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 client.27704.objecter ms_dispatch2 0x7f1614000ba0 osd_map(302..302 src has 1..302) 2026-02-13T08:11:53.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 3 client.27704.objecter handle_osd_map got epochs [302,302] > 0 2026-02-13T08:11:53.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 3 client.27704.objecter handle_osd_map decoding full epoch 302 2026-02-13T08:11:53.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 20 client.27704.objecter dump_active .. 0 homeless 2026-02-13T08:11:53.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f16137fe640 10 monclient: get_auth_request con 0x7f15e403b790 auth_method 0 2026-02-13T08:11:53.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.249+0000 7f15effff640 10 client.27704.objecter ms_handle_connect 0x7f15e403b790 2026-02-13T08:11:53.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.253+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f1608017190 con 0x7f161417fe50 2026-02-13T08:11:53.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.253+0000 7f15effff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.253+0000 7f15effff640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:11:53.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:11:53.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:11:53.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 1 -- 10.20.193.104:0/1379549699 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f16140380f0 con 0x7f161417fe50 2026-02-13T08:11:53.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f15effff640 1 -- 10.20.193.104:0/1379549699 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1475 (unknown 254746657 0 1305306109) 0x7f1608016a90 con 0x7f161417fe50 2026-02-13T08:11:53.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f15effff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:11:53.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f15effff640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:11:53.372 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:11:53.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 10 librados: watch_flush enter 2026-02-13T08:11:53.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 10 librados: watch_flush exit 2026-02-13T08:11:53.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 20 client.27704.objecter shutdown clearing up homeless session... 2026-02-13T08:11:53.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 10 client.27704.objecter successfully canceled tick 2026-02-13T08:11:53.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 1 -- 10.20.193.104:0/1379549699 >> v1:10.20.193.119:6812/276487904 conn(0x7f15e403b790 legacy=0x7f15e405bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 10 monclient: shutdown 2026-02-13T08:11:53.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:53.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 1 -- 10.20.193.104:0/1379549699 >> v1:10.20.193.104:6790/0 conn(0x7f161417fe50 legacy=0x7f1614170840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 1 -- 10.20.193.104:0/1379549699 shutdown_connections 2026-02-13T08:11:53.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 1 -- 10.20.193.104:0/1379549699 >> 10.20.193.104:0/1379549699 conn(0x7f1614051e80 msgr2=0x7f161405d030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:53.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 1 -- 10.20.193.104:0/1379549699 shutdown_connections 2026-02-13T08:11:53.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 1 -- 10.20.193.104:0/1379549699 wait complete. 2026-02-13T08:11:53.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.365+0000 7f161a02f640 1 librados: shutdown 2026-02-13T08:11:53.382 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T08:11:53.382 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T08:11:53.383 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T08:11:53.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.445+0000 7f7a2c952640 10 monclient: get_monmap_and_config 2026-02-13T08:11:53.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.445+0000 7f7a2c952640 10 monclient: build_initial_monmap 2026-02-13T08:11:53.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.445+0000 7f7a2c952640 10 monclient: monmap: 2026-02-13T08:11:53.453 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:53.453 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.453 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:11:53.450997+0000 2026-02-13T08:11:53.453 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:11:53.450997+0000 2026-02-13T08:11:53.453 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:53.453 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.453 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:53.453 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:11:53.453 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:11:53.453 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.445+0000 7f7a2c952640 1 Processor -- start 2026-02-13T08:11:53.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.445+0000 7f7a2c952640 1 -- start start 2026-02-13T08:11:53.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.445+0000 7f7a2c952640 10 monclient: init 2026-02-13T08:11:53.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:53.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:11:53.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient(hunting): picked mon.noname-c con 0x7f7a28139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:53.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient(hunting): picked mon.noname-b con 0x7f7a2815e200 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:53.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient(hunting): picked mon.noname-a con 0x7f7a2817fd00 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:53.463 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2813aa00 con 0x7f7a2817fd00 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2808ba20 con 0x7f7a28139f20 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a28089e30 con 0x7f7a2815e200 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient(hunting): authenticate will time out at 819.040144s 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a26d76640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f7a2817fd00 0x7f7a281a00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:53068/0 (socket says 10.20.193.104:53068) 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a26d76640 1 -- 10.20.193.104:0/206546396 learned_addr learned my addr 10.20.193.104:0/206546396 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302808414 0 0) 0x7f7a18002ca0 con 0x7f7a2817fd00 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): my global_id is 94098 2026-02-13T08:11:53.464 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a14003620 con 0x7f7a2817fd00 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738798304 0 0) 0x7f7a28089e30 con 0x7f7a2815e200 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): my global_id is 27707 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a18002ca0 con 0x7f7a2815e200 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 52940631 0 0) 0x7f7a2808ba20 con 0x7f7a28139f20 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient(hunting): my global_id is 74599 2026-02-13T08:11:53.465 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a28089e30 con 0x7f7a28139f20 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2695035219 0 0) 0x7f7a14003620 con 0x7f7a2817fd00 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 >> v1:10.20.193.104:6790/0 conn(0x7f7a2815e200 legacy=0x7f7a2817e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 >> v1:10.20.193.119:6789/0 conn(0x7f7a28139f20 legacy=0x7f7a2813a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient: _finish_hunting 0 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 monclient: found mon.noname-a 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2808a380 con 0x7f7a2817fd00 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient: _finish_auth 0 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient: _check_auth_tickets 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7a18003350 con 0x7f7a2817fd00 2026-02-13T08:11:53.466 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient: dump: 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.467 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 5 monclient: authenticate success, global_id 94098 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a180035a0 con 0x7f7a2817fd00 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 1 -- 10.20.193.104:0/206546396 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7a18004d20 con 0x7f7a2817fd00 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25573640 10 monclient: dump: 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.468 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: get_monmap_and_config success 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 4 set_mon_vals no callback set 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: shutdown 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- 10.20.193.104:0/206546396 >> v1:10.20.193.104:6789/0 conn(0x7f7a2817fd00 legacy=0x7f7a281a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- 10.20.193.104:0/206546396 shutdown_connections 2026-02-13T08:11:53.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- 10.20.193.104:0/206546396 >> 10.20.193.104:0/206546396 conn(0x7f7a28051a50 msgr2=0x7f7a28051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- 10.20.193.104:0/206546396 shutdown_connections 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- 10.20.193.104:0/206546396 wait complete. 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: build_initial_monmap 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: monmap: 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:11:53.470 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 librados: starting msgr at 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 librados: starting objecter 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 Processor -- start 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- start start 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 librados: setting wanted keys 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 librados: calling monclient init 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: init 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient(hunting): picked mon.noname-a con 0x7f7a28139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:53.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient(hunting): picked mon.noname-c con 0x7f7a2815e200 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient(hunting): picked mon.noname-b con 0x7f7a2817fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a28162b40 con 0x7f7a28139f20 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a28162e20 con 0x7f7a2817fd00 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2817edc0 con 0x7f7a2815e200 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient(hunting): authenticate will time out at 819.042082s 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25d74640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f7a2815e200 0x7f7a2817e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50828/0 (socket says 10.20.193.104:50828) 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a25d74640 1 -- 10.20.193.104:0/638565058 learned_addr learned my addr 10.20.193.104:0/638565058 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 client.?.objecter ms_handle_connect 0x7f7a2815e200 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 client.?.objecter ms_handle_connect 0x7f7a28139f20 2026-02-13T08:11:53.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2358472365 0 0) 0x7f7a2817edc0 con 0x7f7a2815e200 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): my global_id is 27710 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79f4003620 con 0x7f7a2815e200 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304677789 0 0) 0x7f7a28162b40 con 0x7f7a28139f20 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): my global_id is 94101 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a2817edc0 con 0x7f7a28139f20 2026-02-13T08:11:53.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4077977800 0 0) 0x7f79f4003620 con 0x7f7a2815e200 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a28162b40 con 0x7f7a2815e200 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7a100030e0 con 0x7f7a2815e200 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): dump: 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.474 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2924560742 0 0) 0x7f7a2817edc0 con 0x7f7a28139f20 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f79f4003620 con 0x7f7a28139f20 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7a1c003070 con 0x7f7a28139f20 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): dump: 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.475 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1171472177 0 0) 0x7f79f4003620 con 0x7f7a28139f20 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 >> v1:10.20.193.104:6790/0 conn(0x7f7a2815e200 legacy=0x7f7a2817e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 >> v1:10.20.193.119:6789/0 conn(0x7f7a2817fd00 legacy=0x7f7a28127ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: _finish_hunting 0 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 monclient: found mon.a 2026-02-13T08:11:53.476 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:53.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:53.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a28161fb0 con 0x7f7a28139f20 2026-02-13T08:11:53.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: _finish_auth 0 2026-02-13T08:11:53.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: _check_auth_tickets 2026-02-13T08:11:53.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:53.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 5 monclient: authenticate success, global_id 94101 2026-02-13T08:11:53.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: _renew_subs 2026-02-13T08:11:53.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:53.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a28160ac0 con 0x7f7a28139f20 2026-02-13T08:11:53.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 client.94101.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:11:53.477 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: _renew_subs 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a2817fa00 con 0x7f7a28139f20 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 librados: init done 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a1c003710 con 0x7f7a28139f20 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7a1c003b10 con 0x7f7a28139f20 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: dump: 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.478 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a24d72640 4 set_mon_vals no callback set 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a2c952640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7a281619f0 con 0x7f7a28161620 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f7a1c003cb0 con 0x7f7a28139f20 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 client.94101.objecter ms_handle_connect 0x7f7a28161620 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 client.94101.objecter resend_mon_ops 2026-02-13T08:11:53.479 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(302..302 src has 1..302) ==== 5163+0+0 (unknown 1312576247 0 0) 0x7f7a1c049590 con 0x7f7a28139f20 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 client.94101.objecter ms_dispatch2 0x7f7a28000ba0 osd_map(302..302 src has 1..302) 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 3 client.94101.objecter handle_osd_map got epochs [302,302] > 0 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 3 client.94101.objecter handle_osd_map decoding full epoch 302 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 20 client.94101.objecter dump_active .. 0 homeless 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2238492351 0 0) 0x7f7a281619f0 con 0x7f7a28161620 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient(hunting): my global_id is 94104 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79f4003620 con 0x7f7a28161620 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 24960513 0 0) 0x7f79f4003620 con 0x7f7a28161620 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a281619f0 con 0x7f7a28161620 2026-02-13T08:11:53.480 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7a10003ba0 con 0x7f7a28161620 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: dump: 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.481 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a26d76640 10 monclient: get_auth_request con 0x7f79f403b790 auth_method 0 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4147338026 0 0) 0x7f7a281619f0 con 0x7f7a28161620 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a281626f0 con 0x7f7a28161620 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f7a100058c0 con 0x7f7a28161620 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 >> v1:10.20.193.104:6789/0 conn(0x7f7a28161620 legacy=0x7f7a28058890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 >> v1:10.20.193.104:6789/0 conn(0x7f7a28161620 legacy=0x7f7a28058890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.449+0000 7f7a0effd640 10 client.94101.objecter ms_handle_connect 0x7f79f403b790 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a2c952640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a2c952640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7a280380f0 con 0x7f7a28058fa0 2026-02-13T08:11:53.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 10 client.94101.objecter ms_handle_connect 0x7f7a28058fa0 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 10 client.94101.objecter resend_mon_ops 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707101536 0 0) 0x7f7a280380f0 con 0x7f7a28058fa0 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 10 monclient(hunting): my global_id is 94107 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a281619f0 con 0x7f7a28058fa0 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4013664704 0 0) 0x7f7a281619f0 con 0x7f7a28058fa0 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a280380f0 con 0x7f7a28058fa0 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7a100041d0 con 0x7f7a28058fa0 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 10 monclient: dump: 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 836096064 0 0) 0x7f7a280380f0 con 0x7f7a28058fa0 2026-02-13T08:11:53.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 --> v1:10.20.193.104:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7a28088e20 con 0x7f7a28058fa0 2026-02-13T08:11:53.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4157 (unknown 0 0 607762155) 0x7f7a10004030 con 0x7f7a28058fa0 2026-02-13T08:11:53.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:11:53.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:11:53.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 >> v1:10.20.193.104:6789/0 conn(0x7f7a28058fa0 legacy=0x7f7a2812a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.453+0000 7f7a0effd640 1 -- 10.20.193.104:0/638565058 >> v1:10.20.193.104:6789/0 conn(0x7f7a28058fa0 legacy=0x7f7a2812a1e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:53.485 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:11:53.485 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 44, 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 227, 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:53.486 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:53.487 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:53.488 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:53.489 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:53.490 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.491 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:53.492 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:11:53.493 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:11:53.494 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: "num": 2 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:11:53.495 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:11:53.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 10 librados: watch_flush enter 2026-02-13T08:11:53.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 10 librados: watch_flush exit 2026-02-13T08:11:53.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 20 client.94101.objecter shutdown clearing up homeless session... 2026-02-13T08:11:53.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 10 client.94101.objecter successfully canceled tick 2026-02-13T08:11:53.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 1 -- 10.20.193.104:0/638565058 >> v1:10.20.193.119:6812/276487904 conn(0x7f79f403b790 legacy=0x7f79f405bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 10 monclient: shutdown 2026-02-13T08:11:53.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:53.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 1 -- 10.20.193.104:0/638565058 >> v1:10.20.193.104:6789/0 conn(0x7f7a28139f20 legacy=0x7f7a2817dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a26d76640 1 -- 10.20.193.104:0/638565058 reap_dead start 2026-02-13T08:11:53.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a26d76640 1 -- 10.20.193.104:0/638565058 reap_dead start 2026-02-13T08:11:53.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 1 -- 10.20.193.104:0/638565058 shutdown_connections 2026-02-13T08:11:53.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 1 -- 10.20.193.104:0/638565058 >> 10.20.193.104:0/638565058 conn(0x7f7a28051a50 msgr2=0x7f7a2813abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:53.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 1 -- 10.20.193.104:0/638565058 shutdown_connections 2026-02-13T08:11:53.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 1 -- 10.20.193.104:0/638565058 wait complete. 2026-02-13T08:11:53.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.457+0000 7f7a2c952640 1 librados: shutdown 2026-02-13T08:11:53.498 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:11:53.498 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T08:11:53.499 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T08:11:53.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 10 monclient: get_monmap_and_config 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 10 monclient: build_initial_monmap 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 10 monclient: monmap: 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:11:53.566369+0000 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:11:53.566369+0000 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:11:53.568 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 1 Processor -- start 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 1 -- start start 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 10 monclient: init 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 10 monclient(hunting): picked mon.noname-b con 0x7f4be8091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 10 monclient(hunting): picked mon.noname-c con 0x7f4be813f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 10 monclient(hunting): picked mon.noname-a con 0x7f4be813fcd0 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be808e5f0 con 0x7f4be813fcd0 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be808e8d0 con 0x7f4be813f870 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be808ebb0 con 0x7f4be8091740 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bef13f640 10 monclient(hunting): authenticate will time out at 819.155594s 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4beceb4640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f4be8091740 0x7f4be813f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50832/0 (socket says 10.20.193.104:50832) 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4beceb4640 1 -- 10.20.193.104:0/2209060251 learned_addr learned my addr 10.20.193.104:0/2209060251 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:53.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 1 -- 10.20.193.104:0/2209060251 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708360203 0 0) 0x7f4be808ebb0 con 0x7f4be8091740 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 10 monclient(hunting): my global_id is 27713 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 1 -- 10.20.193.104:0/2209060251 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bd4003620 con 0x7f4be8091740 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 1 -- 10.20.193.104:0/2209060251 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1608736698 0 0) 0x7f4be808e5f0 con 0x7f4be813fcd0 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 10 monclient(hunting): my global_id is 94110 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.561+0000 7f4bdf7fe640 1 -- 10.20.193.104:0/2209060251 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be808ebb0 con 0x7f4be813fcd0 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 1 -- 10.20.193.104:0/2209060251 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2230517823 0 0) 0x7f4bd4003620 con 0x7f4be8091740 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 1 -- 10.20.193.104:0/2209060251 >> v1:10.20.193.119:6789/0 conn(0x7f4be813f870 legacy=0x7f4be8180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 1 -- 10.20.193.104:0/2209060251 >> v1:10.20.193.104:6789/0 conn(0x7f4be813fcd0 legacy=0x7f4be81a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 1 monclient: found mon.noname-b 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 1 -- 10.20.193.104:0/2209060251 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be8091b10 con 0x7f4be8091740 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 10 monclient: _finish_auth 0 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 1 -- 10.20.193.104:0/2209060251 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4bd8002e00 con 0x7f4be8091740 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 5 monclient: authenticate success, global_id 27713 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 10 monclient: dump: 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.579 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 1 -- 10.20.193.104:0/2209060251 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4bd8003050 con 0x7f4be8091740 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 1 -- 10.20.193.104:0/2209060251 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4bd8003490 con 0x7f4be8091740 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdf7fe640 10 monclient: dump: 2026-02-13T08:11:53.580 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient: get_monmap_and_config success 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 4 set_mon_vals no callback set 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient: shutdown 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- 10.20.193.104:0/2209060251 >> v1:10.20.193.104:6790/0 conn(0x7f4be8091740 legacy=0x7f4be813f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- 10.20.193.104:0/2209060251 shutdown_connections 2026-02-13T08:11:53.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- 10.20.193.104:0/2209060251 >> 10.20.193.104:0/2209060251 conn(0x7f4be8090810 msgr2=0x7f4be8090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- 10.20.193.104:0/2209060251 shutdown_connections 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- 10.20.193.104:0/2209060251 wait complete. 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient: build_initial_monmap 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient: monmap: 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 librados: starting msgr at 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 librados: starting objecter 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 Processor -- start 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- start start 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 librados: setting wanted keys 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 librados: calling monclient init 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient: init 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient(hunting): picked mon.noname-a con 0x7f4be8091740 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient(hunting): picked mon.noname-b con 0x7f4be813f870 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient(hunting): picked mon.noname-c con 0x7f4be813fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be812fc10 con 0x7f4be8091740 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be812cc10 con 0x7f4be813f870 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be808ab30 con 0x7f4be813fcd0 2026-02-13T08:11:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient(hunting): authenticate will time out at 819.157421s 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bed6b5640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f4be813fcd0 0x7f4be81917a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50844/0 (socket says 10.20.193.104:50844) 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bed6b5640 1 -- 10.20.193.104:0/2944234744 learned_addr learned my addr 10.20.193.104:0/2944234744 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 client.?.objecter ms_handle_connect 0x7f4be8091740 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 client.?.objecter ms_handle_connect 0x7f4be813fcd0 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 900305229 0 0) 0x7f4be812fc10 con 0x7f4be8091740 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): my global_id is 94113 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bb8003620 con 0x7f4be8091740 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2429171464 0 0) 0x7f4be808ab30 con 0x7f4be813fcd0 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): my global_id is 27716 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be812fc10 con 0x7f4be813fcd0 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 client.?.objecter ms_handle_connect 0x7f4be813f870 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 197012043 0 0) 0x7f4bb8003620 con 0x7f4be8091740 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4be808ab30 con 0x7f4be8091740 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4bd8003200 con 0x7f4be8091740 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): dump: 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.585 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2939723771 0 0) 0x7f4be812fc10 con 0x7f4be813fcd0 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4bb8003620 con 0x7f4be813fcd0 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4be4003550 con 0x7f4be813fcd0 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): dump: 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.586 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636063837 0 0) 0x7f4be812cc10 con 0x7f4be813f870 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): my global_id is 74605 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be812fc10 con 0x7f4be813f870 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3691377855 0 0) 0x7f4be808ab30 con 0x7f4be8091740 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 >> v1:10.20.193.104:6790/0 conn(0x7f4be813fcd0 legacy=0x7f4be81917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 >> v1:10.20.193.119:6789/0 conn(0x7f4be813f870 legacy=0x7f4be812c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: _finish_hunting 0 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 monclient: found mon.a 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be812eda0 con 0x7f4be8091740 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: _finish_auth 0 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: _check_auth_tickets 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 5 monclient: authenticate success, global_id 94113 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient: _renew_subs 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4be812f930 con 0x7f4be8091740 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 client.94113.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient: _renew_subs 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:53.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4be812e670 con 0x7f4be8091740 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 librados: init done 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4bd8004cf0 con 0x7f4be8091740 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4bd8003050 con 0x7f4be8091740 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: dump: 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.589 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdeffd640 4 set_mon_vals no callback set 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bef13f640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4be8061860 con 0x7f4be8088820 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 client.94113.objecter ms_handle_connect 0x7f4be8088820 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 client.94113.objecter resend_mon_ops 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f4bd8010d10 con 0x7f4be8091740 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(302..302 src has 1..302) ==== 5163+0+0 (unknown 1312576247 0 0) 0x7f4bd804a8f0 con 0x7f4be8091740 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 client.94113.objecter ms_dispatch2 0x7f4be8000ba0 osd_map(302..302 src has 1..302) 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 3 client.94113.objecter handle_osd_map got epochs [302,302] > 0 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 3 client.94113.objecter handle_osd_map decoding full epoch 302 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 20 client.94113.objecter dump_active .. 0 homeless 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3670776344 0 0) 0x7f4be8061860 con 0x7f4be8088820 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient(hunting): my global_id is 27719 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be808ab30 con 0x7f4be8088820 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1762192635 0 0) 0x7f4be808ab30 con 0x7f4be8088820 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4be8061860 con 0x7f4be8088820 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4bd0002ed0 con 0x7f4be8088820 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bed6b5640 10 monclient: get_auth_request con 0x7f4bb803baf0 auth_method 0 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: dump: 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.591 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2174984900 0 0) 0x7f4be8061860 con 0x7f4be8088820 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4be8059110 con 0x7f4be8088820 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 client.94113.objecter ms_handle_connect 0x7f4bb803baf0 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f4bd00052a0 con 0x7f4be8088820 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 >> v1:10.20.193.104:6790/0 conn(0x7f4be8088820 legacy=0x7f4be8088bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.565+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 >> v1:10.20.193.104:6790/0 conn(0x7f4be8088820 legacy=0x7f4be8088bf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4be80896d0 con 0x7f4be8089300 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 10 client.94113.objecter ms_handle_connect 0x7f4be8089300 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 10 client.94113.objecter resend_mon_ops 2026-02-13T08:11:53.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3308216390 0 0) 0x7f4be80896d0 con 0x7f4be8089300 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 10 monclient(hunting): my global_id is 27722 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be8061860 con 0x7f4be8089300 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3951080373 0 0) 0x7f4be8061860 con 0x7f4be8089300 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4be80896d0 con 0x7f4be8089300 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4bd0003520 con 0x7f4be8089300 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 10 monclient: dump: 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.593 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 405017894 0 0) 0x7f4be80896d0 con 0x7f4be8089300 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 --> v1:10.20.193.104:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4be8197780 con 0x7f4be8089300 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4492 (unknown 0 0 2724137717) 0x7f4bd0004a80 con 0x7f4be8089300 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 >> v1:10.20.193.104:6790/0 conn(0x7f4be8089300 legacy=0x7f4be8193ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bdd7fa640 1 -- 10.20.193.104:0/2944234744 >> v1:10.20.193.104:6790/0 conn(0x7f4be8089300 legacy=0x7f4be8193ed0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 44, 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 382976, 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.595 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:53.596 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:53.597 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:53.598 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:53.599 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:53.600 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:53.601 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.602 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.603 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: "num": 3 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.604 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:11:53.605 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.605 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:53.605 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:53.605 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:11:53.605 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.605 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.605 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.605 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:11:53.605 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:11:53.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 10 librados: watch_flush enter 2026-02-13T08:11:53.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 10 librados: watch_flush exit 2026-02-13T08:11:53.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 20 client.94113.objecter shutdown clearing up homeless session... 2026-02-13T08:11:53.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 10 client.94113.objecter successfully canceled tick 2026-02-13T08:11:53.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 1 -- 10.20.193.104:0/2944234744 >> v1:10.20.193.119:6812/276487904 conn(0x7f4bb803baf0 legacy=0x7f4bb805bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 10 monclient: shutdown 2026-02-13T08:11:53.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:53.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 1 -- 10.20.193.104:0/2944234744 >> v1:10.20.193.104:6789/0 conn(0x7f4be8091740 legacy=0x7f4be812bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bed6b5640 1 -- 10.20.193.104:0/2944234744 reap_dead start 2026-02-13T08:11:53.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bed6b5640 1 -- 10.20.193.104:0/2944234744 reap_dead start 2026-02-13T08:11:53.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 1 -- 10.20.193.104:0/2944234744 shutdown_connections 2026-02-13T08:11:53.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 1 -- 10.20.193.104:0/2944234744 >> 10.20.193.104:0/2944234744 conn(0x7f4be8090810 msgr2=0x7f4be808bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:53.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 1 -- 10.20.193.104:0/2944234744 shutdown_connections 2026-02-13T08:11:53.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 1 -- 10.20.193.104:0/2944234744 wait complete. 2026-02-13T08:11:53.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.569+0000 7f4bef13f640 1 librados: shutdown 2026-02-13T08:11:53.607 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:11:53.607 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T08:11:53.608 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient: get_monmap_and_config 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient: build_initial_monmap 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient: monmap: 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:11:53.666492+0000 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:11:53.666492+0000 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:11:53.668 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 1 Processor -- start 2026-02-13T08:11:53.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 1 -- start start 2026-02-13T08:11:53.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient: init 2026-02-13T08:11:53.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:53.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:11:53.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient(hunting): picked mon.noname-b con 0x7fd94813f690 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:53.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient(hunting): picked mon.noname-c con 0x7fd94808d940 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:53.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient(hunting): picked mon.noname-a con 0x7fd94808dd60 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:53.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94808b890 con 0x7fd94808dd60 2026-02-13T08:11:53.674 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd94808bb70 con 0x7fd94808d940 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd948089f10 con 0x7fd94813f690 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient(hunting): authenticate will time out at 819.255209s 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ca81640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fd94813f690 0x7fd94808d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50882/0 (socket says 10.20.193.104:50882) 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ca81640 1 -- 10.20.193.104:0/2830399574 learned_addr learned my addr 10.20.193.104:0/2830399574 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 -- 10.20.193.104:0/2830399574 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582302304 0 0) 0x7fd948089f10 con 0x7fd94813f690 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient(hunting): my global_id is 27725 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 -- 10.20.193.104:0/2830399574 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd934003620 con 0x7fd94813f690 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 -- 10.20.193.104:0/2830399574 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328898886 0 0) 0x7fd94808b890 con 0x7fd94808dd60 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient(hunting): my global_id is 94116 2026-02-13T08:11:53.675 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 -- 10.20.193.104:0/2830399574 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd948089f10 con 0x7fd94808dd60 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 -- 10.20.193.104:0/2830399574 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 202782985 0 0) 0x7fd948089f10 con 0x7fd94808dd60 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 -- 10.20.193.104:0/2830399574 >> v1:10.20.193.104:6790/0 conn(0x7fd94813f690 legacy=0x7fd94808d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 -- 10.20.193.104:0/2830399574 >> v1:10.20.193.119:6789/0 conn(0x7fd94808d940 legacy=0x7fd948180540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 monclient: found mon.noname-a 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 -- 10.20.193.104:0/2830399574 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9481a63c0 con 0x7fd94808dd60 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient: _finish_auth 0 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 -- 10.20.193.104:0/2830399574 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd944003180 con 0x7fd94808dd60 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 5 monclient: authenticate success, global_id 94116 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient: dump: 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.676 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 -- 10.20.193.104:0/2830399574 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9440033c0 con 0x7fd94808dd60 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 10 monclient: get_monmap_and_config success 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 1 -- 10.20.193.104:0/2830399574 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd944003800 con 0x7fd94808dd60 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd94ed0c640 4 set_mon_vals no callback set 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.661+0000 7fd93f7fe640 10 monclient: dump: 2026-02-13T08:11:53.677 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient: shutdown 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- 10.20.193.104:0/2830399574 >> v1:10.20.193.104:6789/0 conn(0x7fd94808dd60 legacy=0x7fd9481a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- 10.20.193.104:0/2830399574 shutdown_connections 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- 10.20.193.104:0/2830399574 >> 10.20.193.104:0/2830399574 conn(0x7fd948051a50 msgr2=0x7fd948051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- 10.20.193.104:0/2830399574 shutdown_connections 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- 10.20.193.104:0/2830399574 wait complete. 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient: build_initial_monmap 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient: monmap: 2026-02-13T08:11:53.678 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 librados: starting msgr at 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 librados: starting objecter 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 Processor -- start 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- start start 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 librados: setting wanted keys 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 librados: calling monclient init 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient: init 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:11:53.679 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient(hunting): picked mon.noname-c con 0x7fd94808d940 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient(hunting): picked mon.noname-a con 0x7fd94808dd60 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient(hunting): picked mon.noname-b con 0x7fd94813f690 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd948128530 con 0x7fd94808dd60 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd948129090 con 0x7fd94813f690 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd948086620 con 0x7fd94808d940 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient(hunting): authenticate will time out at 819.257144s 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ca81640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fd94808d940 0x7fd94814c6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50898/0 (socket says 10.20.193.104:50898) 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ca81640 1 -- 10.20.193.104:0/3835703932 learned_addr learned my addr 10.20.193.104:0/3835703932 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 client.?.objecter ms_handle_connect 0x7fd94808d940 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 client.?.objecter ms_handle_connect 0x7fd94808dd60 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1061738255 0 0) 0x7fd948086620 con 0x7fd94808d940 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): my global_id is 27728 2026-02-13T08:11:53.680 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd918003620 con 0x7fd94808d940 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215933626 0 0) 0x7fd948128530 con 0x7fd94808dd60 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): my global_id is 94119 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd948086620 con 0x7fd94808dd60 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 client.?.objecter ms_handle_connect 0x7fd94813f690 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3030096307 0 0) 0x7fd918003620 con 0x7fd94808d940 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd948128530 con 0x7fd94808d940 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd9380031d0 con 0x7fd94808d940 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): dump: 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.681 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1186889781 0 0) 0x7fd948086620 con 0x7fd94808dd60 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd918003620 con 0x7fd94808dd60 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd930003020 con 0x7fd94808dd60 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): dump: 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.682 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409397449 0 0) 0x7fd948129090 con 0x7fd94813f690 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): my global_id is 74611 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd948086620 con 0x7fd94813f690 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1093915612 0 0) 0x7fd948128530 con 0x7fd94808d940 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 >> v1:10.20.193.119:6789/0 conn(0x7fd94813f690 legacy=0x7fd94818ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 >> v1:10.20.193.104:6789/0 conn(0x7fd94808dd60 legacy=0x7fd94813bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: _finish_hunting 0 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 monclient: found mon.c 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd948129ff0 con 0x7fd94808d940 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: _finish_auth 0 2026-02-13T08:11:53.683 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: _check_auth_tickets 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 5 monclient: authenticate success, global_id 27728 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient: _renew_subs 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd94813cd60 con 0x7fd94808d940 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 client.27728.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient: _renew_subs 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd94813c7a0 con 0x7fd94808d940 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 librados: init done 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9380048e0 con 0x7fd94808d940 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd938004c30 con 0x7fd94808d940 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: dump: 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.684 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93effd640 4 set_mon_vals no callback set 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94ed0c640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd948061860 con 0x7fd9481a35a0 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fd938010c40 con 0x7fd94808d940 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(302..302 src has 1..302) ==== 5163+0+0 (unknown 1312576247 0 0) 0x7fd93804a830 con 0x7fd94808d940 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 client.27728.objecter ms_dispatch2 0x7fd948000ba0 osd_map(302..302 src has 1..302) 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 3 client.27728.objecter handle_osd_map got epochs [302,302] > 0 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 3 client.27728.objecter handle_osd_map decoding full epoch 302 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 20 client.27728.objecter dump_active .. 0 homeless 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd94d282640 10 monclient: get_auth_request con 0x7fd91803ba30 auth_method 0 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 client.27728.objecter ms_handle_connect 0x7fd9481a35a0 2026-02-13T08:11:53.685 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 client.27728.objecter resend_mon_ops 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 client.27728.objecter ms_handle_connect 0x7fd91803ba30 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2636640528 0 0) 0x7fd948061860 con 0x7fd9481a35a0 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient(hunting): my global_id is 74614 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd948128530 con 0x7fd9481a35a0 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1622478023 0 0) 0x7fd948128530 con 0x7fd9481a35a0 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd948061860 con 0x7fd9481a35a0 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd930003a70 con 0x7fd9481a35a0 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: dump: 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.686 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.687 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.687 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.687 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1638185530 0 0) 0x7fd948061860 con 0x7fd9481a35a0 2026-02-13T08:11:53.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.119:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd948086f20 con 0x7fd9481a35a0 2026-02-13T08:11:53.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7fd930003ba0 con 0x7fd9481a35a0 2026-02-13T08:11:53.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:11:53.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 >> v1:10.20.193.119:6789/0 conn(0x7fd9481a35a0 legacy=0x7fd948086810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.665+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 >> v1:10.20.193.119:6789/0 conn(0x7fd9481a35a0 legacy=0x7fd948086810 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:53.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd94ed0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:11:53.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd94ed0c640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd948087670 con 0x7fd948087270 2026-02-13T08:11:53.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 10 client.27728.objecter ms_handle_connect 0x7fd948087270 2026-02-13T08:11:53.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 10 client.27728.objecter resend_mon_ops 2026-02-13T08:11:53.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 247801926 0 0) 0x7fd948087670 con 0x7fd948087270 2026-02-13T08:11:53.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 10 monclient(hunting): my global_id is 74617 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd948061860 con 0x7fd948087270 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1039099439 0 0) 0x7fd948061860 con 0x7fd948087270 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd948087670 con 0x7fd948087270 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd9300041e0 con 0x7fd948087270 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.669+0000 7fd93d7fa640 10 monclient: dump: 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.689 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2097079783 0 0) 0x7fd948087670 con 0x7fd948087270 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 --> v1:10.20.193.119:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd948194a30 con 0x7fd948087270 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4325 (unknown 0 0 3755599435) 0x7fd930005700 con 0x7fd948087270 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd93d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd93d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 >> v1:10.20.193.119:6789/0 conn(0x7fd948087270 legacy=0x7fd948191180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd93d7fa640 1 -- 10.20.193.104:0/3835703932 >> v1:10.20.193.119:6789/0 conn(0x7fd948087270 legacy=0x7fd948191180 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 44, 2026-02-13T08:11:53.690 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 250700, 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:53.691 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:53.692 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:11:53.693 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:11:53.694 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:53.695 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.696 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:53.697 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:11:53.698 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:53.699 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:53.699 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:53.699 INFO:teuthology.orchestra.run.trial104.stdout: "num": 4 2026-02-13T08:11:53.699 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:53.699 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:53.699 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:53.699 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:11:53.699 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:11:53.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 10 librados: watch_flush enter 2026-02-13T08:11:53.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 10 librados: watch_flush exit 2026-02-13T08:11:53.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 20 client.27728.objecter shutdown clearing up homeless session... 2026-02-13T08:11:53.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 10 client.27728.objecter successfully canceled tick 2026-02-13T08:11:53.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 1 -- 10.20.193.104:0/3835703932 >> v1:10.20.193.119:6812/276487904 conn(0x7fd91803ba30 legacy=0x7fd91805bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 10 monclient: shutdown 2026-02-13T08:11:53.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:53.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 1 -- 10.20.193.104:0/3835703932 >> v1:10.20.193.104:6790/0 conn(0x7fd94808d940 legacy=0x7fd94814c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94d282640 1 -- 10.20.193.104:0/3835703932 reap_dead start 2026-02-13T08:11:53.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 1 -- 10.20.193.104:0/3835703932 shutdown_connections 2026-02-13T08:11:53.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 1 -- 10.20.193.104:0/3835703932 >> 10.20.193.104:0/3835703932 conn(0x7fd948051a50 msgr2=0x7fd94805ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:53.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 1 -- 10.20.193.104:0/3835703932 shutdown_connections 2026-02-13T08:11:53.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 1 -- 10.20.193.104:0/3835703932 wait complete. 2026-02-13T08:11:53.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.673+0000 7fd94ed0c640 1 librados: shutdown 2026-02-13T08:11:53.701 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:11:53.701 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T08:11:53.701 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T08:11:53.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient: get_monmap_and_config 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient: build_initial_monmap 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient: monmap: 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:11:53.769306+0000 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:11:53.769306+0000 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:11:53.771 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 Processor -- start 2026-02-13T08:11:53.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 -- start start 2026-02-13T08:11:53.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient: init 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient(hunting): picked mon.noname-c con 0x7f764013c0c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient(hunting): picked mon.noname-b con 0x7f764013cba0 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient(hunting): picked mon.noname-a con 0x7f7640181f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f764008ee60 con 0x7f7640181f20 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76400870f0 con 0x7f764013c0c0 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7640087330 con 0x7f764013cba0 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient(hunting): authenticate will time out at 819.358006s 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f76456b9640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f764013cba0 0x7f7640180800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50904/0 (socket says 10.20.193.104:50904) 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f76456b9640 1 -- 10.20.193.104:0/3557792076 learned_addr learned my addr 10.20.193.104:0/3557792076 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f76466bb640 1 --1- 10.20.193.104:0/3557792076 >> v1:10.20.193.104:6789/0 conn(0x7f7640181f20 0x7f76401a2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:53170/0 (socket says 10.20.193.104:53170) 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f76466bb640 1 -- 10.20.193.104:0/3557792076 >> v1:10.20.193.104:6789/0 conn(0x7f7640181f20 legacy=0x7f76401a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-13T08:11:53.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f76466bb640 1 -- 10.20.193.104:0/3557792076 >> v1:10.20.193.104:6789/0 conn(0x7f7640181f20 legacy=0x7f76401a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f76466bb640 1 --1- 10.20.193.104:0/3557792076 >> v1:10.20.193.104:6789/0 conn(0x7f7640181f20 0x7f76401a2300 :-1 s=OPENED pgs=8577 cs=1 l=1).handle_message read tag failed 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f76466bb640 1 --1- 10.20.193.104:0/3557792076 >> v1:10.20.193.104:6789/0 conn(0x7f7640181f20 0x7f76401a2300 :-1 s=OPENED pgs=8577 cs=1 l=1).fault on lossy channel, failing 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.104:6789/0 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 -- 10.20.193.104:0/3557792076 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2739182051 0 0) 0x7f7640087330 con 0x7f764013cba0 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient(hunting): my global_id is 27731 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 -- 10.20.193.104:0/3557792076 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7628003620 con 0x7f764013cba0 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 -- 10.20.193.104:0/3557792076 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876137617 0 0) 0x7f76400870f0 con 0x7f764013c0c0 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient(hunting): my global_id is 74620 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 -- 10.20.193.104:0/3557792076 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7640087330 con 0x7f764013c0c0 2026-02-13T08:11:53.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 -- 10.20.193.104:0/3557792076 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2882619713 0 0) 0x7f7628003620 con 0x7f764013cba0 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 -- 10.20.193.104:0/3557792076 >> v1:10.20.193.119:6789/0 conn(0x7f764013c0c0 legacy=0x7f764013c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 -- 10.20.193.104:0/3557792076 >> v1:10.20.193.104:6789/0 conn(0x7f7640181f20 legacy=0x7f76401a2300 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient: _finish_hunting 0 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 monclient: found mon.noname-b 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 -- 10.20.193.104:0/3557792076 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7640140150 con 0x7f764013cba0 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient: _finish_auth 0 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient: _check_auth_tickets 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 -- 10.20.193.104:0/3557792076 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7634002d30 con 0x7f764013cba0 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient: dump: 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.779 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 5 monclient: authenticate success, global_id 27731 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 -- 10.20.193.104:0/3557792076 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7634002f70 con 0x7f764013cba0 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 1 -- 10.20.193.104:0/3557792076 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f76340033b0 con 0x7f764013cba0 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7644eb8640 10 monclient: dump: 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.780 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient: get_monmap_and_config success 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 4 set_mon_vals no callback set 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient: shutdown 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 -- 10.20.193.104:0/3557792076 >> v1:10.20.193.104:6790/0 conn(0x7f764013cba0 legacy=0x7f7640180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 -- 10.20.193.104:0/3557792076 shutdown_connections 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 -- 10.20.193.104:0/3557792076 >> 10.20.193.104:0/3557792076 conn(0x7f7640090810 msgr2=0x7f7640090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 -- 10.20.193.104:0/3557792076 shutdown_connections 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 -- 10.20.193.104:0/3557792076 wait complete. 2026-02-13T08:11:53.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient: build_initial_monmap 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient: monmap: 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 librados: starting msgr at 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 librados: starting objecter 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 Processor -- start 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 -- start start 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 librados: setting wanted keys 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 1 librados: calling monclient init 2026-02-13T08:11:53.782 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.765+0000 7f7648145640 10 monclient: init 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient(hunting): picked mon.noname-c con 0x7f764013c0c0 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient(hunting): picked mon.noname-a con 0x7f764013cba0 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient(hunting): picked mon.noname-b con 0x7f7640181f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f764010aa80 con 0x7f764013cba0 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f764010ad60 con 0x7f7640181f20 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f764013dfc0 con 0x7f764013c0c0 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient(hunting): authenticate will time out at 819.360410s 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7645eba640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f764013c0c0 0x7f76401260d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50916/0 (socket says 10.20.193.104:50916) 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7645eba640 1 -- 10.20.193.104:0/3863819133 learned_addr learned my addr 10.20.193.104:0/3863819133 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 client.?.objecter ms_handle_connect 0x7f764013c0c0 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 client.?.objecter ms_handle_connect 0x7f764013cba0 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2898807956 0 0) 0x7f764013dfc0 con 0x7f764013c0c0 2026-02-13T08:11:53.783 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): my global_id is 27734 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7610003620 con 0x7f764013c0c0 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3043919252 0 0) 0x7f764010aa80 con 0x7f764013cba0 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): my global_id is 94122 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f764013dfc0 con 0x7f764013cba0 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 client.?.objecter ms_handle_connect 0x7f7640181f20 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3913967718 0 0) 0x7f7610003620 con 0x7f764013c0c0 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f764010aa80 con 0x7f764013c0c0 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f76300030d0 con 0x7f764013c0c0 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:11:53.784 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): dump: 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2765042298 0 0) 0x7f764010ad60 con 0x7f7640181f20 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): my global_id is 74623 2026-02-13T08:11:53.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7610003620 con 0x7f7640181f20 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 52172312 0 0) 0x7f764013dfc0 con 0x7f764013cba0 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f764010ad60 con 0x7f764013cba0 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7634002c40 con 0x7f764013cba0 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient(hunting): dump: 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 955986429 0 0) 0x7f764010aa80 con 0x7f764013c0c0 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 >> v1:10.20.193.119:6789/0 conn(0x7f7640181f20 legacy=0x7f76401122d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 >> v1:10.20.193.104:6789/0 conn(0x7f764013cba0 legacy=0x7f7640180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient: _finish_hunting 0 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 monclient: found mon.c 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f764013da70 con 0x7f764013c0c0 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient: _finish_auth 0 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient: _check_auth_tickets 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 5 monclient: authenticate success, global_id 27734 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient: _renew_subs 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 1 -- 10.20.193.104:0/3863819133 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f764008ab30 con 0x7f764013c0c0 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 client.27734.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient: _renew_subs 2026-02-13T08:11:53.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 1 -- 10.20.193.104:0/3863819133 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f764010a7a0 con 0x7f764013c0c0 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 1 librados: init done 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7630003500 con 0x7f764013c0c0 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7630003b60 con 0x7f764013c0c0 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762ffff640 4 set_mon_vals no callback set 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient: dump: 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:53.788 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f7648145640 1 -- 10.20.193.104:0/3863819133 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7640061860 con 0x7f764013c0c0 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f7630003d00 con 0x7f764013c0c0 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(302..302 src has 1..302) ==== 5163+0+0 (unknown 1312576247 0 0) 0x7f763004a950 con 0x7f764013c0c0 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 client.27734.objecter ms_dispatch2 0x7f7640000ba0 osd_map(302..302 src has 1..302) 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 3 client.27734.objecter handle_osd_map got epochs [302,302] > 0 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 3 client.27734.objecter handle_osd_map decoding full epoch 302 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 20 client.27734.objecter dump_active .. 0 homeless 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f76456b9640 10 monclient: get_auth_request con 0x7f761003ba40 auth_method 0 2026-02-13T08:11:53.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 client.27734.objecter ms_handle_connect 0x7f761003ba40 2026-02-13T08:11:53.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f7630016d50 con 0x7f764013c0c0 2026-02-13T08:11:53.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:53.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.769+0000 7f762e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:11:53.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.881+0000 7f7648145640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T08:11:53.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.881+0000 7f7648145640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T08:11:53.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.881+0000 7f7648145640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:53.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.881+0000 7f7648145640 1 -- 10.20.193.104:0/3863819133 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f76401a3a20 con 0x7f764013c0c0 2026-02-13T08:11:53.889 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.881+0000 7f762e7fc640 1 -- 10.20.193.104:0/3863819133 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f7630016650 con 0x7f764013c0c0 2026-02-13T08:11:53.889 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.881+0000 7f762e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T08:11:53.889 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.881+0000 7f762e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:11:53.889 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.881+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.890 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.881+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=1,health=12,kv=8,logm=63} crc {auth=1360977889,config=1228700967,health=2969413476,kv=2250276570,logm=1335255433}) 2026-02-13T08:11:53.890 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.881+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=2,health=13,kv=10,logm=60} crc {auth=1312769842,config=3140514009,health=3090723219,kv=1692168360,logm=2221305853}) 2026-02-13T08:11:53.890 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.881+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.890 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.881+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=16,config=1,health=12,kv=8,logm=63} crc {auth=1360977889,config=1228700967,health=2969413476,kv=2250276570,logm=1335255433}) 2026-02-13T08:11:53.890 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.881+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=16,config=2,health=13,kv=9,logm=60} crc {auth=2679511686,config=55734535,health=3090723219,kv=4002461713,logm=3902225936}) 2026-02-13T08:11:53.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 10 librados: watch_flush enter 2026-02-13T08:11:53.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 10 librados: watch_flush exit 2026-02-13T08:11:53.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 20 client.27734.objecter shutdown clearing up homeless session... 2026-02-13T08:11:53.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 10 client.27734.objecter successfully canceled tick 2026-02-13T08:11:53.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 1 -- 10.20.193.104:0/3863819133 >> v1:10.20.193.119:6812/276487904 conn(0x7f761003ba40 legacy=0x7f761005bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 10 monclient: shutdown 2026-02-13T08:11:53.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:53.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 1 -- 10.20.193.104:0/3863819133 >> v1:10.20.193.104:6790/0 conn(0x7f764013c0c0 legacy=0x7f76401260d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:53.892 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 1 -- 10.20.193.104:0/3863819133 shutdown_connections 2026-02-13T08:11:53.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 1 -- 10.20.193.104:0/3863819133 >> 10.20.193.104:0/3863819133 conn(0x7f7640090810 msgr2=0x7f76400575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:53.892 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2371963773}) 2026-02-13T08:11:53.893 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4268365874}) 2026-02-13T08:11:53.893 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.893 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2371963773}) 2026-02-13T08:11:53.893 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2557185118}) 2026-02-13T08:11:53.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 1 -- 10.20.193.104:0/3863819133 shutdown_connections 2026-02-13T08:11:53.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 1 -- 10.20.193.104:0/3863819133 wait complete. 2026-02-13T08:11:53.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:53.885+0000 7f7648145640 1 librados: shutdown 2026-02-13T08:11:53.899 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.899 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=237051780}) 2026-02-13T08:11:53.899 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2778022745}) 2026-02-13T08:11:53.899 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.899 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=237051780}) 2026-02-13T08:11:53.899 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3971439232}) 2026-02-13T08:11:53.899 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.899 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2232086513}) 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=983961341}) 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2232086513}) 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3334190208}) 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4007420399}) 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1505272382}) 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4007420399}) 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=621640888}) 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1999402801}) 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4168025212}) 2026-02-13T08:11:53.900 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1999402801}) 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2604855604}) 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3008501963}) 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3338446872}) 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3008501963}) 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.885+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1194064832}) 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3838122121}) 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=651679583}) 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3838122121}) 2026-02-13T08:11:53.901 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=463232006}) 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=314385963}) 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3793585966}) 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=314385963}) 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2564094759}) 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1731099225}) 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1976422246}) 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1731099225}) 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2350634244}) 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.902 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=983810594}) 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4239976899}) 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=983810594}) 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1684033146}) 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=521241900}) 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1297997667}) 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=521241900}) 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2454118343}) 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2358725246}) 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=835784715}) 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.903 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2358725246}) 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=148031604}) 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666923811}) 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3517089625}) 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666923811}) 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1049406040}) 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=27590542}) 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3187024921}) 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=27590542}) 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1197150565}) 2026-02-13T08:11:53.904 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1366482891}) 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1055177}) 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.889+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1366482891}) 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1059842066}) 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3370165418}) 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1044142563}) 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3370165418}) 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2683285886}) 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1187985081}) 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1517026839}) 2026-02-13T08:11:53.905 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.906 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1187985081}) 2026-02-13T08:11:53.906 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3430374686}) 2026-02-13T08:11:53.906 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.906 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2401068829}) 2026-02-13T08:11:53.906 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4032389241}) 2026-02-13T08:11:53.906 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.906 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2401068829}) 2026-02-13T08:11:53.906 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3067727045}) 2026-02-13T08:11:53.907 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T08:11:53.912 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.912 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3760349666}) 2026-02-13T08:11:53.912 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2352798417}) 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3760349666}) 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2474036094}) 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3220271219}) 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2318470564}) 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3220271219}) 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3935553143}) 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1756430831}) 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1764471501}) 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.913 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1756430831}) 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2353414823}) 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=323636069}) 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3861611397}) 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=323636069}) 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=928047159}) 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3435708984}) 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=955318134}) 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3435708984}) 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.893+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2451267980}) 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.914 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1430009216}) 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1534336368}) 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1430009216}) 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1150978453}) 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3799535447}) 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1238302885}) 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3799535447}) 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1492192475}) 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.915 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2418083192}) 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=210895067}) 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2418083192}) 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4004524915}) 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=651892659}) 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=182894313}) 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=651892659}) 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3124016437}) 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340412745}) 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2201516427}) 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.916 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340412745}) 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2749054300}) 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3931005793}) 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1729790976}) 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3931005793}) 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=181585988}) 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=11,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=15,osdmap=29} crc {logm=3017572942,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=15445671,mon_config_key=1358190956,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=2315316943,osd_pg_creating=1016586354,osd_snap=2266049112,osdmap=3558278110}) 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=11,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=7,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=30} crc {logm=3017572942,mdsmap=3140514009,mgr=3181626538,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=1366449296,mon_config_key=1358190956,monmap=2810143972,nvmeofgw=3360707892,osd_metadata=2315316943,osd_pg_creating=1016586354,osd_snap=1215326330,osdmap=3546787476}) 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=11,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=15,osdmap=29} crc {logm=3017572942,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=15445671,mon_config_key=1358190956,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=2315316943,osd_pg_creating=1016586354,osd_snap=2266049112,osdmap=3558278110}) 2026-02-13T08:11:53.917 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=11,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=14,osdmap=31} crc {logm=3017572942,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=276141631,mon_config_key=1358190956,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=1843503482,osd_pg_creating=1016586354,osd_snap=2235084466,osdmap=1864708229}) 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3812503649}) 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2034673822}) 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3812503649}) 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.897+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2647265636}) 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4216940994}) 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4257154605}) 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4216940994}) 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3373014255}) 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.918 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3178313491}) 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1596562050}) 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3178313491}) 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=934930499}) 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2935120163}) 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=428193196}) 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2935120163}) 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=4257857887}) 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=16} crc {osdmap=747725286}) 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=18} crc {osdmap=4086387922}) 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:11:53.919 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=16} crc {osdmap=747725286}) 2026-02-13T08:11:53.920 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:11:53.901+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=18} crc {osdmap=4086387922}) 2026-02-13T08:11:54.908 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T08:11:54.909 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:11:54.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 10 monclient: get_monmap_and_config 2026-02-13T08:11:54.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 10 monclient: build_initial_monmap 2026-02-13T08:11:54.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 10 monclient: monmap: 2026-02-13T08:11:54.976 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:54.977 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:54.977 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:11:54.974818+0000 2026-02-13T08:11:54.977 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:11:54.974818+0000 2026-02-13T08:11:54.977 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:54.977 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:54.977 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:54.977 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:11:54.977 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:11:54.977 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:54.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 1 Processor -- start 2026-02-13T08:11:54.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 1 -- start start 2026-02-13T08:11:54.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 10 monclient: init 2026-02-13T08:11:54.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:54.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:11:54.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 10 monclient(hunting): picked mon.noname-b con 0x7fbc44057eb0 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:54.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 10 monclient(hunting): picked mon.noname-c con 0x7fbc4408c8e0 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:54.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 10 monclient(hunting): picked mon.noname-a con 0x7fbc44181970 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:54.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4408dba0 con 0x7fbc44181970 2026-02-13T08:11:54.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc44090da0 con 0x7fbc4408c8e0 2026-02-13T08:11:54.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc44091130 con 0x7fbc44057eb0 2026-02-13T08:11:54.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:54.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4abb9640 10 monclient(hunting): authenticate will time out at 820.563488s 2026-02-13T08:11:54.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4892e640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fbc44057eb0 0x7fbc4408c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50930/0 (socket says 10.20.193.104:50930) 2026-02-13T08:11:54.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc4892e640 1 -- 10.20.193.104:0/3032689911 learned_addr learned my addr 10.20.193.104:0/3032689911 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 1 -- 10.20.193.104:0/3032689911 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2535507874 0 0) 0x7fbc44091130 con 0x7fbc44057eb0 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 10 monclient(hunting): my global_id is 27737 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 1 -- 10.20.193.104:0/3032689911 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc30003620 con 0x7fbc44057eb0 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 1 -- 10.20.193.104:0/3032689911 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2064281879 0 0) 0x7fbc4408dba0 con 0x7fbc44181970 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 10 monclient(hunting): my global_id is 94125 2026-02-13T08:11:54.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 1 -- 10.20.193.104:0/3032689911 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc44091130 con 0x7fbc44181970 2026-02-13T08:11:54.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 1 -- 10.20.193.104:0/3032689911 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1458974869 0 0) 0x7fbc44091130 con 0x7fbc44181970 2026-02-13T08:11:54.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.968+0000 7fbc3b7fe640 1 -- 10.20.193.104:0/3032689911 >> v1:10.20.193.104:6790/0 conn(0x7fbc44057eb0 legacy=0x7fbc4408c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:54.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 1 -- 10.20.193.104:0/3032689911 >> v1:10.20.193.119:6789/0 conn(0x7fbc4408c8e0 legacy=0x7fbc4408cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:54.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:11:54.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 1 monclient: found mon.noname-a 2026-02-13T08:11:54.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:54.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:11:54.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 1 -- 10.20.193.104:0/3032689911 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc44058280 con 0x7fbc44181970 2026-02-13T08:11:54.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 10 monclient: _finish_auth 0 2026-02-13T08:11:54.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:11:54.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:54.989 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 1 -- 10.20.193.104:0/3032689911 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fbc40003180 con 0x7fbc44181970 2026-02-13T08:11:54.989 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:54.989 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:11:54.989 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 10 monclient: dump: 2026-02-13T08:11:54.989 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:54.989 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:54.989 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:54.989 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:54.989 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:54.989 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:54.989 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 5 monclient: authenticate success, global_id 94125 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 1 -- 10.20.193.104:0/3032689911 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbc400033c0 con 0x7fbc44181970 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 1 -- 10.20.193.104:0/3032689911 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fbc400037d0 con 0x7fbc44181970 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3b7fe640 10 monclient: dump: 2026-02-13T08:11:54.990 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: get_monmap_and_config success 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 4 set_mon_vals no callback set 2026-02-13T08:11:54.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: shutdown 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3032689911 >> v1:10.20.193.104:6789/0 conn(0x7fbc44181970 legacy=0x7fbc441a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3032689911 shutdown_connections 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3032689911 >> 10.20.193.104:0/3032689911 conn(0x7fbc4408e2d0 msgr2=0x7fbc4408e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3032689911 shutdown_connections 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3032689911 wait complete. 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: build_initial_monmap 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: monmap: 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:11:54.992 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 librados: starting msgr at 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 librados: starting objecter 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 Processor -- start 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- start start 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 librados: setting wanted keys 2026-02-13T08:11:54.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 librados: calling monclient init 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: init 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient(hunting): picked mon.noname-b con 0x7fbc44057eb0 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient(hunting): picked mon.noname-c con 0x7fbc4408c8e0 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient(hunting): picked mon.noname-a con 0x7fbc44181970 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4407caf0 con 0x7fbc44181970 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4407cdd0 con 0x7fbc44057eb0 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc4407b8f0 con 0x7fbc4408c8e0 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient(hunting): authenticate will time out at 820.565904s 2026-02-13T08:11:54.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4912f640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fbc44181970 0x7fbc44170380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:53198/0 (socket says 10.20.193.104:53198) 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3bfff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fbc4408c8e0 0x7fbc4416ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50944/0 (socket says 10.20.193.104:50944) 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4912f640 1 -- 10.20.193.104:0/3185910047 learned_addr learned my addr 10.20.193.104:0/3185910047 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 client.?.objecter ms_handle_connect 0x7fbc44181970 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 client.?.objecter ms_handle_connect 0x7fbc4408c8e0 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776103560 0 0) 0x7fbc4407caf0 con 0x7fbc44181970 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): my global_id is 94128 2026-02-13T08:11:54.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc14003620 con 0x7fbc44181970 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 client.?.objecter ms_handle_connect 0x7fbc44057eb0 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3772460655 0 0) 0x7fbc4407b8f0 con 0x7fbc4408c8e0 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): my global_id is 27740 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc4407caf0 con 0x7fbc4408c8e0 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4032349507 0 0) 0x7fbc4407cdd0 con 0x7fbc44057eb0 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): _negotiate 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:54.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): my global_id is 74629 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc4407b8f0 con 0x7fbc44057eb0 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3069043922 0 0) 0x7fbc14003620 con 0x7fbc44181970 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc4407cdd0 con 0x7fbc44181970 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fbc40003090 con 0x7fbc44181970 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): dump: 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:54.997 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 987758362 0 0) 0x7fbc4407caf0 con 0x7fbc4408c8e0 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc14003620 con 0x7fbc4408c8e0 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fbc2c003060 con 0x7fbc4408c8e0 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:54.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient(hunting): dump: 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2963007425 0 0) 0x7fbc4407cdd0 con 0x7fbc44181970 2026-02-13T08:11:54.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 >> v1:10.20.193.104:6790/0 conn(0x7fbc4408c8e0 legacy=0x7fbc4416ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 >> v1:10.20.193.119:6789/0 conn(0x7fbc44057eb0 legacy=0x7fbc4412dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient: _finish_hunting 0 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 monclient: found mon.a 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc44086720 con 0x7fbc44181970 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient: _finish_auth 0 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient: _check_auth_tickets 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 5 monclient: authenticate success, global_id 94128 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: _renew_subs 2026-02-13T08:11:55.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3185910047 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbc44090260 con 0x7fbc44181970 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 client.94128.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: _renew_subs 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3185910047 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbc4405ce40 con 0x7fbc44181970 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 librados: init done 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbc400033a0 con 0x7fbc44181970 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fbc40003ee0 con 0x7fbc44181970 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:55.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 monclient: dump: 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc3affd640 4 set_mon_vals no callback set 2026-02-13T08:11:55.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3185910047 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc4407d160 con 0x7fbc44181970 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fbc40004100 con 0x7fbc44181970 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(303..303 src has 1..303) ==== 4745+0+0 (unknown 3280846627 0 0) 0x7fbc4004aa70 con 0x7fbc44181970 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 client.94128.objecter ms_dispatch2 0x7fbc44000ba0 osd_map(303..303 src has 1..303) 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 3 client.94128.objecter handle_osd_map got epochs [303,303] > 0 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 3 client.94128.objecter handle_osd_map decoding full epoch 303 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 20 client.94128.objecter dump_active .. 0 homeless 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc4892e640 10 monclient: get_auth_request con 0x7fbc1403b970 auth_method 0 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.972+0000 7fbc397fa640 10 client.94128.objecter ms_handle_connect 0x7fbc1403b970 2026-02-13T08:11:55.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.976+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7fbc400170d0 con 0x7fbc44181970 2026-02-13T08:11:55.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.976+0000 7fbc397fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:55.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:54.976+0000 7fbc397fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:11:55.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:11:55.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:11:55.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:55.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3185910047 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbc440380f0 con 0x7fbc44181970 2026-02-13T08:11:55.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc397fa640 1 -- 10.20.193.104:0/3185910047 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1475 (unknown 254746657 0 2712563667) 0x7fbc400048c0 con 0x7fbc44181970 2026-02-13T08:11:55.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc397fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:11:55.095 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc397fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:11:55.096 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":44,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:11:55.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 10 librados: watch_flush enter 2026-02-13T08:11:55.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 10 librados: watch_flush exit 2026-02-13T08:11:55.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 20 client.94128.objecter shutdown clearing up homeless session... 2026-02-13T08:11:55.097 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 10 client.94128.objecter successfully canceled tick 2026-02-13T08:11:55.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3185910047 >> v1:10.20.193.119:6812/276487904 conn(0x7fbc1403b970 legacy=0x7fbc1405be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 10 monclient: shutdown 2026-02-13T08:11:55.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:55.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3185910047 >> v1:10.20.193.104:6789/0 conn(0x7fbc44181970 legacy=0x7fbc44170380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3185910047 shutdown_connections 2026-02-13T08:11:55.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3185910047 >> 10.20.193.104:0/3185910047 conn(0x7fbc4408e2d0 msgr2=0x7fbc44085680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:55.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3185910047 shutdown_connections 2026-02-13T08:11:55.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 1 -- 10.20.193.104:0/3185910047 wait complete. 2026-02-13T08:11:55.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.088+0000 7fbc4abb9640 1 librados: shutdown 2026-02-13T08:11:55.105 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T08:11:55.105 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-13T08:11:55.105 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T08:11:55.105 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T08:11:55.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient: get_monmap_and_config 2026-02-13T08:11:55.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient: build_initial_monmap 2026-02-13T08:11:55.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient: monmap: 2026-02-13T08:11:55.168 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:55.168 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.168 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:11:55.166227+0000 2026-02-13T08:11:55.168 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:11:55.166227+0000 2026-02-13T08:11:55.168 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:55.168 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.168 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:55.168 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:11:55.168 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:11:55.169 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 1 Processor -- start 2026-02-13T08:11:55.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 1 -- start start 2026-02-13T08:11:55.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient: init 2026-02-13T08:11:55.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:55.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:11:55.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient(hunting): picked mon.noname-b con 0x7f2fe813f690 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:55.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient(hunting): picked mon.noname-c con 0x7f2fe808d940 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:55.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient(hunting): picked mon.noname-a con 0x7f2fe808dd60 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:55.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe808b890 con 0x7f2fe808dd60 2026-02-13T08:11:55.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe808bb70 con 0x7f2fe808d940 2026-02-13T08:11:55.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe8089f10 con 0x7f2fe813f690 2026-02-13T08:11:55.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:55.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient(hunting): authenticate will time out at 820.754938s 2026-02-13T08:11:55.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fee0be640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f2fe813f690 0x7f2fe808d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50952/0 (socket says 10.20.193.104:50952) 2026-02-13T08:11:55.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fee0be640 1 -- 10.20.193.104:0/700801362 learned_addr learned my addr 10.20.193.104:0/700801362 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:55.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 -- 10.20.193.104:0/700801362 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938007881 0 0) 0x7f2fe8089f10 con 0x7f2fe813f690 2026-02-13T08:11:55.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient(hunting): my global_id is 27743 2026-02-13T08:11:55.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 -- 10.20.193.104:0/700801362 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd0003620 con 0x7f2fe813f690 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 -- 10.20.193.104:0/700801362 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741062362 0 0) 0x7f2fe808b890 con 0x7f2fe808dd60 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient(hunting): my global_id is 94131 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 -- 10.20.193.104:0/700801362 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fe8089f10 con 0x7f2fe808dd60 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 -- 10.20.193.104:0/700801362 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2802843138 0 0) 0x7f2fd0003620 con 0x7f2fe813f690 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 -- 10.20.193.104:0/700801362 >> v1:10.20.193.119:6789/0 conn(0x7f2fe808d940 legacy=0x7f2fe8180540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 -- 10.20.193.104:0/700801362 >> v1:10.20.193.104:6789/0 conn(0x7f2fe808dd60 legacy=0x7f2fe81a1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient: _finish_hunting 0 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 monclient: found mon.noname-b 2026-02-13T08:11:55.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 -- 10.20.193.104:0/700801362 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe81a63c0 con 0x7f2fe813f690 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient: _finish_auth 0 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient: _check_auth_tickets 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 -- 10.20.193.104:0/700801362 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2fd8002e00 con 0x7f2fe813f690 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient: dump: 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.180 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 5 monclient: authenticate success, global_id 27743 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 -- 10.20.193.104:0/700801362 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fd8003080 con 0x7f2fe813f690 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 1 -- 10.20.193.104:0/700801362 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2fd80034c0 con 0x7f2fe813f690 2026-02-13T08:11:55.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2fed0bc640 10 monclient: dump: 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient: get_monmap_and_config success 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 4 set_mon_vals no callback set 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 10 monclient: shutdown 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 1 -- 10.20.193.104:0/700801362 >> v1:10.20.193.104:6790/0 conn(0x7f2fe813f690 legacy=0x7f2fe808d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 1 -- 10.20.193.104:0/700801362 shutdown_connections 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 1 -- 10.20.193.104:0/700801362 >> 10.20.193.104:0/700801362 conn(0x7f2fe8051a50 msgr2=0x7f2fe8051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 1 -- 10.20.193.104:0/700801362 shutdown_connections 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.160+0000 7f2ff0349640 1 -- 10.20.193.104:0/700801362 wait complete. 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient: build_initial_monmap 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient: monmap: 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:11:55.183 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:11:55.184 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:11:55.184 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:55.184 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.184 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:55.184 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:11:55.184 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:11:55.184 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.184 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 librados: starting msgr at 2026-02-13T08:11:55.184 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 librados: starting objecter 2026-02-13T08:11:55.184 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 Processor -- start 2026-02-13T08:11:55.184 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 -- start start 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 librados: setting wanted keys 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 librados: calling monclient init 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient: init 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient(hunting): picked mon.noname-c con 0x7f2fe808d940 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient(hunting): picked mon.noname-a con 0x7f2fe808dd60 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient(hunting): picked mon.noname-b con 0x7f2fe813f690 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe8128520 con 0x7f2fe808dd60 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe8129fe0 con 0x7f2fe813f690 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe812a2c0 con 0x7f2fe808d940 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:55.185 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient(hunting): authenticate will time out at 820.756816s 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fee0be640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f2fe808d940 0x7f2fe813beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50956/0 (socket says 10.20.193.104:50956) 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fee0be640 1 -- 10.20.193.104:0/752163898 learned_addr learned my addr 10.20.193.104:0/752163898 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 client.?.objecter ms_handle_connect 0x7f2fe808dd60 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 client.?.objecter ms_handle_connect 0x7f2fe808d940 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1614535108 0 0) 0x7f2fe812a2c0 con 0x7f2fe808d940 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): my global_id is 27746 2026-02-13T08:11:55.186 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fb8003620 con 0x7f2fe808d940 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3003450621 0 0) 0x7f2fe8128520 con 0x7f2fe808dd60 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): my global_id is 94134 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fe812a2c0 con 0x7f2fe808dd60 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 client.?.objecter ms_handle_connect 0x7f2fe813f690 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3605388132 0 0) 0x7f2fe812a2c0 con 0x7f2fe808dd60 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fe8128520 con 0x7f2fe808dd60 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2fdc002cd0 con 0x7f2fe808dd60 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:55.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): dump: 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3424281784 0 0) 0x7f2fb8003620 con 0x7f2fe808d940 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fe812a2c0 con 0x7f2fe808d940 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2fd8002d10 con 0x7f2fe808d940 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): dump: 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.189 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3670777373 0 0) 0x7f2fe8129fe0 con 0x7f2fe813f690 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): my global_id is 74632 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fb8003620 con 0x7f2fe813f690 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 670263932 0 0) 0x7f2fe8128520 con 0x7f2fe808dd60 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 >> v1:10.20.193.104:6790/0 conn(0x7f2fe808d940 legacy=0x7f2fe813beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 >> v1:10.20.193.119:6789/0 conn(0x7f2fe813f690 legacy=0x7f2fe818f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: _finish_hunting 0 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 monclient: found mon.a 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe8129080 con 0x7f2fe808dd60 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: _finish_auth 0 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: _check_auth_tickets 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 5 monclient: authenticate success, global_id 94134 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient: _renew_subs 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:55.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe813cd50 con 0x7f2fe808dd60 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 client.94134.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient: _renew_subs 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2fe813c790 con 0x7f2fe808dd60 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 librados: init done 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fdc003350 con 0x7f2fe808dd60 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2fdc0039c0 con 0x7f2fe808dd60 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: dump: 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.192 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fec8bb640 4 set_mon_vals no callback set 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2ff0349640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2fe8061860 con 0x7f2fe81a35a0 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f2fdc00f9d0 con 0x7f2fe808dd60 2026-02-13T08:11:55.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 client.94134.objecter ms_handle_connect 0x7f2fe81a35a0 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 client.94134.objecter resend_mon_ops 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(303..303 src has 1..303) ==== 4745+0+0 (unknown 3280846627 0 0) 0x7f2fdc0493e0 con 0x7f2fe808dd60 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 client.94134.objecter ms_dispatch2 0x7f2fe8000ba0 osd_map(303..303 src has 1..303) 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 3 client.94134.objecter handle_osd_map got epochs [303,303] > 0 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 3 client.94134.objecter handle_osd_map decoding full epoch 303 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 20 client.94134.objecter dump_active .. 0 homeless 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1585217893 0 0) 0x7f2fe8061860 con 0x7f2fe81a35a0 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient(hunting): my global_id is 94137 2026-02-13T08:11:55.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fe8128520 con 0x7f2fe81a35a0 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1330398997 0 0) 0x7f2fe8128520 con 0x7f2fe81a35a0 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fe8061860 con 0x7f2fe81a35a0 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2fd8004be0 con 0x7f2fe81a35a0 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: dump: 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.195 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2399203728 0 0) 0x7f2fe8061860 con 0x7f2fe81a35a0 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fe814c940 con 0x7f2fe81a35a0 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fee8bf640 10 monclient: get_auth_request con 0x7f2fb803bc40 auth_method 0 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f2fd8004b70 con 0x7f2fe81a35a0 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 >> v1:10.20.193.104:6789/0 conn(0x7f2fe81a35a0 legacy=0x7f2fe8086690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 >> v1:10.20.193.104:6789/0 conn(0x7f2fe81a35a0 legacy=0x7f2fe8086690 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:55.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.164+0000 7f2fceffd640 10 client.94134.objecter ms_handle_connect 0x7f2fb803bc40 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2fe80874b0 con 0x7f2fe814caf0 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 10 client.94134.objecter ms_handle_connect 0x7f2fe814caf0 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 10 client.94134.objecter resend_mon_ops 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123418762 0 0) 0x7f2fe80874b0 con 0x7f2fe814caf0 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 10 monclient(hunting): my global_id is 94140 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fe8061860 con 0x7f2fe814caf0 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2113885690 0 0) 0x7f2fe8061860 con 0x7f2fe814caf0 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fe80874b0 con 0x7f2fe814caf0 2026-02-13T08:11:55.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2fd8005130 con 0x7f2fe814caf0 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 10 monclient: dump: 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.198 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.199 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 221963337 0 0) 0x7f2fe80874b0 con 0x7f2fe814caf0 2026-02-13T08:11:55.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 --> v1:10.20.193.104:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2fe8087680 con 0x7f2fe814caf0 2026-02-13T08:11:55.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4158 (unknown 0 0 2490887342) 0x7f2fd8007450 con 0x7f2fe814caf0 2026-02-13T08:11:55.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:11:55.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:11:55.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 >> v1:10.20.193.104:6789/0 conn(0x7f2fe814caf0 legacy=0x7f2fe8086da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fceffd640 1 -- 10.20.193.104:0/752163898 >> v1:10.20.193.104:6789/0 conn(0x7f2fe814caf0 legacy=0x7f2fe8086da0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:55.199 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:11:55.200 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:11:55.200 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:11:55.200 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:11:55.200 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 44, 2026-02-13T08:11:55.200 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 1943, 2026-02-13T08:11:55.200 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:11:55.200 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:11:55.200 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:11:55.200 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:11:55.200 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.201 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 1, 2026-02-13T08:11:55.201 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:55.201 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:11:55.201 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:11:55.201 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:55.201 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:55.201 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:55.201 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:55.201 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:55.201 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:55.201 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:55.202 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:11:55.203 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:11:55.204 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.205 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:11:55.206 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.207 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:11:55.208 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:55.209 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout: "num": 2 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:11:55.210 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 10 librados: watch_flush enter 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 10 librados: watch_flush exit 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 20 client.94134.objecter shutdown clearing up homeless session... 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 10 client.94134.objecter successfully canceled tick 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 1 -- 10.20.193.104:0/752163898 >> v1:10.20.193.119:6812/276487904 conn(0x7f2fb803bc40 legacy=0x7f2fb805c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 10 monclient: shutdown 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 1 -- 10.20.193.104:0/752163898 >> v1:10.20.193.104:6789/0 conn(0x7f2fe808dd60 legacy=0x7f2fe818da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fee8bf640 1 -- 10.20.193.104:0/752163898 reap_dead start 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2fee8bf640 1 -- 10.20.193.104:0/752163898 reap_dead start 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 1 -- 10.20.193.104:0/752163898 shutdown_connections 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 1 -- 10.20.193.104:0/752163898 >> 10.20.193.104:0/752163898 conn(0x7f2fe8051a50 msgr2=0x7f2fe805ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 1 -- 10.20.193.104:0/752163898 shutdown_connections 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 1 -- 10.20.193.104:0/752163898 wait complete. 2026-02-13T08:11:55.212 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.168+0000 7f2ff0349640 1 librados: shutdown 2026-02-13T08:11:55.213 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:11:55.213 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T08:11:55.213 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T08:11:55.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.264+0000 7f0645f70640 10 monclient: get_monmap_and_config 2026-02-13T08:11:55.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.264+0000 7f0645f70640 10 monclient: build_initial_monmap 2026-02-13T08:11:55.273 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.264+0000 7f0645f70640 10 monclient: monmap: 2026-02-13T08:11:55.273 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:55.273 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.273 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:11:55.271523+0000 2026-02-13T08:11:55.273 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:11:55.271523+0000 2026-02-13T08:11:55.273 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:55.274 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.274 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:55.274 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:11:55.274 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:11:55.274 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.264+0000 7f0645f70640 1 Processor -- start 2026-02-13T08:11:55.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.264+0000 7f0645f70640 1 -- start start 2026-02-13T08:11:55.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.264+0000 7f0645f70640 10 monclient: init 2026-02-13T08:11:55.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:55.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:11:55.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient(hunting): picked mon.noname-c con 0x7f064013ef60 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:55.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient(hunting): picked mon.noname-b con 0x7f064013f330 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:55.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient(hunting): picked mon.noname-a con 0x7f06401819c0 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:55.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064013fe80 con 0x7f06401819c0 2026-02-13T08:11:55.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064005d8f0 con 0x7f064013ef60 2026-02-13T08:11:55.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064005e160 con 0x7f064013f330 2026-02-13T08:11:55.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:55.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient(hunting): authenticate will time out at 820.860202s 2026-02-13T08:11:55.284 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063effd640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f064013f330 0x7f06401802a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50964/0 (socket says 10.20.193.104:50964) 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063effd640 1 -- 10.20.193.104:0/951334138 learned_addr learned my addr 10.20.193.104:0/951334138 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063ffff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f06401819c0 0x7f06401a1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:53248/0 (socket says 10.20.193.104:53248) 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 -- 10.20.193.104:0/951334138 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1365447023 0 0) 0x7f064013fe80 con 0x7f06401819c0 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient(hunting): my global_id is 94143 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 -- 10.20.193.104:0/951334138 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0624003620 con 0x7f06401819c0 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 -- 10.20.193.104:0/951334138 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658730251 0 0) 0x7f064005e160 con 0x7f064013f330 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.285 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient(hunting): my global_id is 27749 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 -- 10.20.193.104:0/951334138 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f064013fe80 con 0x7f064013f330 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 -- 10.20.193.104:0/951334138 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1214306081 0 0) 0x7f064013fe80 con 0x7f064013f330 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 -- 10.20.193.104:0/951334138 >> v1:10.20.193.119:6789/0 conn(0x7f064013ef60 legacy=0x7f064008c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 -- 10.20.193.104:0/951334138 >> v1:10.20.193.104:6789/0 conn(0x7f06401819c0 legacy=0x7f06401a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient: _finish_hunting 0 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 monclient: found mon.noname-b 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 -- 10.20.193.104:0/951334138 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064005d390 con 0x7f064013f330 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient: _finish_auth 0 2026-02-13T08:11:55.286 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient: _check_auth_tickets 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 -- 10.20.193.104:0/951334138 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0630002d80 con 0x7f064013f330 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient: dump: 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.287 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 5 monclient: authenticate success, global_id 27749 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 -- 10.20.193.104:0/951334138 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0630003000 con 0x7f064013f330 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 1 -- 10.20.193.104:0/951334138 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0630003440 con 0x7f064013f330 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063e7fc640 10 monclient: dump: 2026-02-13T08:11:55.288 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.289 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.289 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.289 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.289 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.289 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.289 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.289 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.289 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.289 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: get_monmap_and_config success 2026-02-13T08:11:55.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 4 set_mon_vals no callback set 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: shutdown 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- 10.20.193.104:0/951334138 >> v1:10.20.193.104:6790/0 conn(0x7f064013f330 legacy=0x7f06401802a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- 10.20.193.104:0/951334138 shutdown_connections 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- 10.20.193.104:0/951334138 >> 10.20.193.104:0/951334138 conn(0x7f064008d040 msgr2=0x7f064008d410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- 10.20.193.104:0/951334138 shutdown_connections 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- 10.20.193.104:0/951334138 wait complete. 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: build_initial_monmap 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: monmap: 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:11:55.290 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 librados: starting msgr at 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 librados: starting objecter 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 Processor -- start 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- start start 2026-02-13T08:11:55.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 librados: setting wanted keys 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 librados: calling monclient init 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: init 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient(hunting): picked mon.noname-b con 0x7f064013ef60 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient(hunting): picked mon.noname-c con 0x7f064013f330 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient(hunting): picked mon.noname-a con 0x7f06401819c0 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064007a950 con 0x7f06401819c0 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0640078200 con 0x7f064013ef60 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0640055f30 con 0x7f064013f330 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient(hunting): authenticate will time out at 820.862496s 2026-02-13T08:11:55.292 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063effd640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f064013f330 0x7f0640077af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:50980/0 (socket says 10.20.193.104:50980) 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063effd640 1 -- 10.20.193.104:0/3273934120 learned_addr learned my addr 10.20.193.104:0/3273934120 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 client.?.objecter ms_handle_connect 0x7f06401819c0 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 client.?.objecter ms_handle_connect 0x7f064013f330 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3445477710 0 0) 0x7f0640055f30 con 0x7f064013f330 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): my global_id is 27752 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0610003620 con 0x7f064013f330 2026-02-13T08:11:55.293 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3291364586 0 0) 0x7f064007a950 con 0x7f06401819c0 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): my global_id is 94146 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0640055f30 con 0x7f06401819c0 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 client.?.objecter ms_handle_connect 0x7f064013ef60 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 191843138 0 0) 0x7f0610003620 con 0x7f064013f330 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f064007a950 con 0x7f064013f330 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0630002c90 con 0x7f064013f330 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:55.294 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): dump: 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:11:55.295 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 373563622 0 0) 0x7f0640055f30 con 0x7f06401819c0 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0610003620 con 0x7f06401819c0 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166895523 0 0) 0x7f0640078200 con 0x7f064013ef60 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): my global_id is 74638 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0640055f30 con 0x7f064013ef60 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0634003410 con 0x7f06401819c0 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): dump: 2026-02-13T08:11:55.296 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1994956855 0 0) 0x7f064007a950 con 0x7f064013f330 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 >> v1:10.20.193.119:6789/0 conn(0x7f064013ef60 legacy=0x7f06400773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.297 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 >> v1:10.20.193.104:6789/0 conn(0x7f06401819c0 legacy=0x7f0640180eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient: _finish_hunting 0 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 monclient: found mon.c 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0640079ae0 con 0x7f064013f330 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient: _finish_auth 0 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient: _check_auth_tickets 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 5 monclient: authenticate success, global_id 27752 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: _renew_subs 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f064007a670 con 0x7f064013f330 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 client.27752.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:11:55.298 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: _renew_subs 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0630004b90 con 0x7f064013f330 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f06400793b0 con 0x7f064013f330 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 librados: init done 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0630004fa0 con 0x7f064013f330 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient: dump: 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.299 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f063dffb640 4 set_mon_vals no callback set 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f0645f70640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0640061860 con 0x7f06401815c0 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 client.27752.objecter ms_handle_connect 0x7f06401815c0 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 client.27752.objecter resend_mon_ops 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2217516729 0 0) 0x7f0640061860 con 0x7f06401815c0 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.300 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient(hunting): my global_id is 27755 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f064007a950 con 0x7f06401815c0 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1914579151 0 0) 0x7f064007a950 con 0x7f06401815c0 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0640061860 con 0x7f06401815c0 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f062c002f10 con 0x7f06401815c0 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 10 monclient: dump: 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.301 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.268+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f0630005140 con 0x7f064013f330 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(303..303 src has 1..303) ==== 4745+0+0 (unknown 3280846627 0 0) 0x7f063004a5d0 con 0x7f064013f330 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 client.27752.objecter ms_dispatch2 0x7f0640000ba0 osd_map(303..303 src has 1..303) 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 3 client.27752.objecter handle_osd_map got epochs [303,303] > 0 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 3 client.27752.objecter handle_osd_map decoding full epoch 303 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 20 client.27752.objecter dump_active .. 0 homeless 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 638359245 0 0) 0x7f0640061860 con 0x7f06401815c0 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f064008a5a0 con 0x7f06401815c0 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f063ffff640 10 monclient: get_auth_request con 0x7f061003ba90 auth_method 0 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f062c0044b0 con 0x7f06401815c0 2026-02-13T08:11:55.302 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 >> v1:10.20.193.104:6790/0 conn(0x7f06401815c0 legacy=0x7f06400880e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 >> v1:10.20.193.104:6790/0 conn(0x7f06401815c0 legacy=0x7f06400880e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 client.27752.objecter ms_handle_connect 0x7f061003ba90 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f0645f70640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f0645f70640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0640088f00 con 0x7f06401a34c0 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 client.27752.objecter ms_handle_connect 0x7f06401a34c0 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 client.27752.objecter resend_mon_ops 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 936250179 0 0) 0x7f0640088f00 con 0x7f06401a34c0 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 monclient(hunting): my global_id is 27758 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0640061860 con 0x7f06401a34c0 2026-02-13T08:11:55.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1631937992 0 0) 0x7f0640061860 con 0x7f06401a34c0 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0640088f00 con 0x7f06401a34c0 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f062c0031a0 con 0x7f06401a34c0 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.272+0000 7f061bfff640 10 monclient: dump: 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1077774787 0 0) 0x7f0640088f00 con 0x7f06401a34c0 2026-02-13T08:11:55.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 --> v1:10.20.193.104:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f064012d8f0 con 0x7f06401a34c0 2026-02-13T08:11:55.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4492 (unknown 0 0 1556748671) 0x7f062c003230 con 0x7f06401a34c0 2026-02-13T08:11:55.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f061bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:11:55.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f061bfff640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:11:55.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 >> v1:10.20.193.104:6790/0 conn(0x7f06401a34c0 legacy=0x7f06400887f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f061bfff640 1 -- 10.20.193.104:0/3273934120 >> v1:10.20.193.104:6790/0 conn(0x7f06401a34c0 legacy=0x7f06400887f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:55.305 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:11:55.305 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:11:55.305 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:11:55.305 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:11:55.305 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 44, 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 384684, 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 1, 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:55.306 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:55.307 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:11:55.308 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:55.309 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.310 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:11:55.311 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:55.312 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.313 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: "num": 4 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:11:55.314 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:11:55.315 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 10 librados: watch_flush enter 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 10 librados: watch_flush exit 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 20 client.27752.objecter shutdown clearing up homeless session... 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 10 client.27752.objecter successfully canceled tick 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 1 -- 10.20.193.104:0/3273934120 >> v1:10.20.193.119:6812/276487904 conn(0x7f061003ba90 legacy=0x7f061005bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 10 monclient: shutdown 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 1 -- 10.20.193.104:0/3273934120 >> v1:10.20.193.104:6790/0 conn(0x7f064013f330 legacy=0x7f0640077af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f063ffff640 1 -- 10.20.193.104:0/3273934120 reap_dead start 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f063ffff640 1 -- 10.20.193.104:0/3273934120 reap_dead start 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 1 -- 10.20.193.104:0/3273934120 shutdown_connections 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 1 -- 10.20.193.104:0/3273934120 >> 10.20.193.104:0/3273934120 conn(0x7f064008d040 msgr2=0x7f064008e660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 1 -- 10.20.193.104:0/3273934120 shutdown_connections 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 1 -- 10.20.193.104:0/3273934120 wait complete. 2026-02-13T08:11:55.316 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.276+0000 7f0645f70640 1 librados: shutdown 2026-02-13T08:11:55.316 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:11:55.317 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T08:11:55.317 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T08:11:55.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: get_monmap_and_config 2026-02-13T08:11:55.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: build_initial_monmap 2026-02-13T08:11:55.378 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: monmap: 2026-02-13T08:11:55.378 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:55.378 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.378 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:11:55.376107+0000 2026-02-13T08:11:55.378 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:11:55.376107+0000 2026-02-13T08:11:55.378 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:55.378 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.378 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:55.378 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:11:55.378 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:11:55.378 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.387 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 Processor -- start 2026-02-13T08:11:55.387 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- start start 2026-02-13T08:11:55.387 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: init 2026-02-13T08:11:55.387 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:55.387 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:11:55.387 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient(hunting): picked mon.noname-b con 0x7f217c090840 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient(hunting): picked mon.noname-c con 0x7f217c08c7e0 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient(hunting): picked mon.noname-a con 0x7f217c08cbe0 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c090d40 con 0x7f217c08cbe0 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c08db10 con 0x7f217c08c7e0 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c05e080 con 0x7f217c090840 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient(hunting): authenticate will time out at 820.965041s 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f217affd640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f217c090840 0x7f217c08c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:51010/0 (socket says 10.20.193.104:51010) 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f217affd640 1 -- 10.20.193.104:0/78862063 learned_addr learned my addr 10.20.193.104:0/78862063 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 -- 10.20.193.104:0/78862063 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88892420 0 0) 0x7f217c05e080 con 0x7f217c090840 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.388 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient(hunting): my global_id is 27761 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 -- 10.20.193.104:0/78862063 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2168003620 con 0x7f217c090840 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 -- 10.20.193.104:0/78862063 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846381159 0 0) 0x7f217c090d40 con 0x7f217c08cbe0 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient(hunting): my global_id is 94149 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 -- 10.20.193.104:0/78862063 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f217c05e080 con 0x7f217c08cbe0 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 -- 10.20.193.104:0/78862063 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2092026131 0 0) 0x7f2168003620 con 0x7f217c090840 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 -- 10.20.193.104:0/78862063 >> v1:10.20.193.119:6789/0 conn(0x7f217c08c7e0 legacy=0x7f217c1805b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 -- 10.20.193.104:0/78862063 >> v1:10.20.193.104:6789/0 conn(0x7f217c08cbe0 legacy=0x7f217c1a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 monclient: found mon.noname-b 2026-02-13T08:11:55.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 -- 10.20.193.104:0/78862063 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c1a6430 con 0x7f217c090840 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient: _finish_auth 0 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 -- 10.20.193.104:0/78862063 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2170002e00 con 0x7f217c090840 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient: dump: 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.390 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 5 monclient: authenticate success, global_id 27761 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 -- 10.20.193.104:0/78862063 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2170003010 con 0x7f217c090840 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 1 -- 10.20.193.104:0/78862063 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2170003450 con 0x7f217c090840 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:55.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f2179ffb640 10 monclient: dump: 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: get_monmap_and_config success 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 4 set_mon_vals no callback set 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: shutdown 2026-02-13T08:11:55.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- 10.20.193.104:0/78862063 >> v1:10.20.193.104:6790/0 conn(0x7f217c090840 legacy=0x7f217c08c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- 10.20.193.104:0/78862063 shutdown_connections 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- 10.20.193.104:0/78862063 >> 10.20.193.104:0/78862063 conn(0x7f217c08e1d0 msgr2=0x7f217c08e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- 10.20.193.104:0/78862063 shutdown_connections 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- 10.20.193.104:0/78862063 wait complete. 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: build_initial_monmap 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: monmap: 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.393 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 librados: starting msgr at 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 librados: starting objecter 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 Processor -- start 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- start start 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 librados: setting wanted keys 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 librados: calling monclient init 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: init 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: _reopen_session rank -1 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:11:55.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient(hunting): picked mon.noname-c con 0x7f217c08c7e0 addr v1:10.20.193.104:6790/0 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient(hunting): picked mon.noname-b con 0x7f217c08cbe0 addr v1:10.20.193.119:6789/0 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient(hunting): picked mon.noname-a con 0x7f217c090840 addr v1:10.20.193.104:6789/0 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c12dbe0 con 0x7f217c090840 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c12dec0 con 0x7f217c08cbe0 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217c086f30 con 0x7f217c08c7e0 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient(hunting): _renew_subs 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient(hunting): authenticate will time out at 820.966674s 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f217affd640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f217c08c7e0 0x7f217c13f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:51018/0 (socket says 10.20.193.104:51018) 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f217affd640 1 -- 10.20.193.104:0/4270159741 learned_addr learned my addr 10.20.193.104:0/4270159741 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 client.?.objecter ms_handle_connect 0x7f217c08c7e0 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 client.?.objecter ms_handle_connect 0x7f217c090840 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:55.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2406513853 0 0) 0x7f217c086f30 con 0x7f217c08c7e0 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): my global_id is 27764 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2148003620 con 0x7f217c08c7e0 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1948508976 0 0) 0x7f217c12dbe0 con 0x7f217c090840 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): my global_id is 94152 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f217c086f30 con 0x7f217c090840 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1465282555 0 0) 0x7f217c086f30 con 0x7f217c090840 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f217c12dbe0 con 0x7f217c090840 2026-02-13T08:11:55.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f216c0032f0 con 0x7f217c090840 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): dump: 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.397 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3948039534 0 0) 0x7f2148003620 con 0x7f217c08c7e0 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f217c086f30 con 0x7f217c08c7e0 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2170002d10 con 0x7f217c08c7e0 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient(hunting): dump: 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.398 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3544449792 0 0) 0x7f217c12dbe0 con 0x7f217c090840 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 >> v1:10.20.193.104:6790/0 conn(0x7f217c08c7e0 legacy=0x7f217c13f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 >> v1:10.20.193.119:6789/0 conn(0x7f217c08cbe0 legacy=0x7f217c18db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 monclient: found mon.a 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217c1a5fa0 con 0x7f217c090840 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient: _finish_auth 0 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 client.?.objecter ms_handle_connect 0x7f217c08cbe0 2026-02-13T08:11:55.399 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 5 monclient: authenticate success, global_id 94152 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: _renew_subs 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f217c0888c0 con 0x7f217c090840 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 client.94152.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: _renew_subs 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f217c13fef0 con 0x7f217c090840 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 librados: init done 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f216c003a90 con 0x7f217c090840 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f216c003ea0 con 0x7f217c090840 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.400 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 10 monclient: dump: 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21797fa640 4 set_mon_vals no callback set 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:55.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f21813e8640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f217c061860 con 0x7f217c1a3610 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.372+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f216c004040 con 0x7f217c090840 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 client.94152.objecter ms_handle_connect 0x7f217c1a3610 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 client.94152.objecter resend_mon_ops 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(304..304 src has 1..304) ==== 4473+0+0 (unknown 4150927136 0 0) 0x7f216c049660 con 0x7f217c090840 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 client.94152.objecter ms_dispatch2 0x7f217c000ba0 osd_map(304..304 src has 1..304) 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 3 client.94152.objecter handle_osd_map got epochs [304,304] > 0 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 3 client.94152.objecter handle_osd_map decoding full epoch 304 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 20 client.94152.objecter dump_active .. 0 homeless 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 118755200 0 0) 0x7f217c061860 con 0x7f217c1a3610 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 monclient(hunting): my global_id is 74641 2026-02-13T08:11:55.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f217c12dbe0 con 0x7f217c1a3610 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1124309350 0 0) 0x7f217c12dbe0 con 0x7f217c1a3610 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f217a7fc640 10 monclient: get_auth_request con 0x7f214803b8f0 auth_method 0 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f217c061860 con 0x7f217c1a3610 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2170004a80 con 0x7f217c1a3610 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 monclient: dump: 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.403 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3118504263 0 0) 0x7f217c061860 con 0x7f217c1a3610 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.119:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f217c13fc00 con 0x7f217c1a3610 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 client.94152.objecter ms_handle_connect 0x7f214803b8f0 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f21700048e0 con 0x7f217c1a3610 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 >> v1:10.20.193.119:6789/0 conn(0x7f217c1a3610 legacy=0x7f217c089c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.376+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 >> v1:10.20.193.119:6789/0 conn(0x7f217c1a3610 legacy=0x7f217c089c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f217c04d110 con 0x7f217c14c990 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 10 client.94152.objecter ms_handle_connect 0x7f217c14c990 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 10 client.94152.objecter resend_mon_ops 2026-02-13T08:11:55.404 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178889213 0 0) 0x7f217c04d110 con 0x7f217c14c990 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 10 monclient(hunting): my global_id is 74644 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f217c061860 con 0x7f217c14c990 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2406475013 0 0) 0x7f217c061860 con 0x7f217c14c990 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f217c04d110 con 0x7f217c14c990 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2170005000 con 0x7f217c14c990 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 10 monclient: dump: 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.405 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2965156026 0 0) 0x7f217c04d110 con 0x7f217c14c990 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 --> v1:10.20.193.119:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f217c194b10 con 0x7f217c14c990 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4325 (unknown 0 0 2801477019) 0x7f2170006510 con 0x7f217c14c990 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 >> v1:10.20.193.119:6789/0 conn(0x7f217c14c990 legacy=0x7f217c04ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.406 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f215b7fe640 1 -- 10.20.193.104:0/4270159741 >> v1:10.20.193.119:6789/0 conn(0x7f217c14c990 legacy=0x7f217c04ca00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 44, 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 252412, 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.407 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 2, 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:55.408 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.409 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:11:55.410 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.411 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:55.412 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:55.413 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:11:55.414 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:11:55.415 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:11:55.416 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:11:55.416 INFO:teuthology.orchestra.run.trial104.stdout: "num": 4 2026-02-13T08:11:55.416 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:11:55.416 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:11:55.416 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:11:55.416 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:11:55.416 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:11:55.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 10 librados: watch_flush enter 2026-02-13T08:11:55.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 10 librados: watch_flush exit 2026-02-13T08:11:55.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 20 client.94152.objecter shutdown clearing up homeless session... 2026-02-13T08:11:55.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 10 client.94152.objecter successfully canceled tick 2026-02-13T08:11:55.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 1 -- 10.20.193.104:0/4270159741 >> v1:10.20.193.119:6812/276487904 conn(0x7f214803b8f0 legacy=0x7f214805bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 10 monclient: shutdown 2026-02-13T08:11:55.417 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:11:55.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 1 -- 10.20.193.104:0/4270159741 >> v1:10.20.193.104:6789/0 conn(0x7f217c090840 legacy=0x7f217c18f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:11:55.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f217b7fe640 1 -- 10.20.193.104:0/4270159741 reap_dead start 2026-02-13T08:11:55.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f217b7fe640 1 -- 10.20.193.104:0/4270159741 reap_dead start 2026-02-13T08:11:55.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 1 -- 10.20.193.104:0/4270159741 shutdown_connections 2026-02-13T08:11:55.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 1 -- 10.20.193.104:0/4270159741 >> 10.20.193.104:0/4270159741 conn(0x7f217c08e1d0 msgr2=0x7f217c1a4960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:11:55.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 1 -- 10.20.193.104:0/4270159741 shutdown_connections 2026-02-13T08:11:55.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 1 -- 10.20.193.104:0/4270159741 wait complete. 2026-02-13T08:11:55.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:11:55.380+0000 7f21813e8640 1 librados: shutdown 2026-02-13T08:11:55.418 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:11:55.418 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c'] 2026-02-13T08:11:55.418 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a'] 2026-02-13T08:11:55.418 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-13T08:11:55.418 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-13T08:11:55.419 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-13T08:11:55.419 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:11:55.435 INFO:tasks.ceph.mon.c:Stopped 2026-02-13T08:11:55.435 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-13T08:11:55.435 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-13T08:11:55.435 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T08:12:10.436 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-13T08:12:10.437 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-13T08:12:10.437 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 2 2026-02-13T08:12:10.437 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:12:10.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 10 monclient: get_monmap_and_config 2026-02-13T08:12:10.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 10 monclient: build_initial_monmap 2026-02-13T08:12:10.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 10 monclient: monmap: 2026-02-13T08:12:10.505 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:12:10.505 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:10.505 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:12:10.503098+0000 2026-02-13T08:12:10.505 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:12:10.503098+0000 2026-02-13T08:12:10.505 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:12:10.506 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:10.506 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:12:10.506 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:12:10.506 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:12:10.506 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:10.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 1 Processor -- start 2026-02-13T08:12:10.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 1 -- start start 2026-02-13T08:12:10.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 10 monclient: init 2026-02-13T08:12:10.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 10 monclient: _reopen_session rank -1 2026-02-13T08:12:10.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:12:10.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 10 monclient(hunting): picked mon.noname-c con 0x7f4f4c08f310 addr v1:10.20.193.119:6789/0 2026-02-13T08:12:10.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 10 monclient(hunting): picked mon.noname-a con 0x7f4f4c1607f0 addr v1:10.20.193.104:6789/0 2026-02-13T08:12:10.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 10 monclient(hunting): picked mon.noname-b con 0x7f4f4c1822f0 addr v1:10.20.193.104:6790/0 2026-02-13T08:12:10.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c08c390 con 0x7f4f4c1607f0 2026-02-13T08:12:10.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c05c6d0 con 0x7f4f4c08f310 2026-02-13T08:12:10.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c08ab80 con 0x7f4f4c1822f0 2026-02-13T08:12:10.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 10 monclient(hunting): _renew_subs 2026-02-13T08:12:10.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f529db640 10 monclient(hunting): authenticate will time out at 836.091899s 2026-02-13T08:12:10.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f50f51640 1 -- >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1822f0 legacy=0x7f4f4c1a26d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:10.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f4b7fe640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f4f4c1607f0 0x7f4f4c180bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:58168/0 (socket says 10.20.193.104:58168) 2026-02-13T08:12:10.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.496+0000 7f4f4b7fe640 1 -- 10.20.193.104:0/505938722 learned_addr learned my addr 10.20.193.104:0/505938722 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:12:10.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:10.704+0000 7f4f50f51640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1822f0 legacy=0x7f4f4c1a26d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:11.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:11.108+0000 7f4f50f51640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1822f0 legacy=0x7f4f4c1a26d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:11.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:11.916+0000 7f4f50f51640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1822f0 legacy=0x7f4f4c1a26d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:13.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 10 monclient(hunting): tick 2026-02-13T08:12:13.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-13T08:12:13.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 1 monclient(hunting): continuing hunt 2026-02-13T08:12:13.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-13T08:12:13.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1822f0 legacy=0x7f4f4c1a26d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:12:13.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.119:6789/0 conn(0x7f4f4c08f310 legacy=0x7f4f4c08f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:13.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.104:6789/0 conn(0x7f4f4c1607f0 legacy=0x7f4f4c180bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:13.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:12:13.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f4f4c1822f0 addr v1:10.20.193.104:6790/0 2026-02-13T08:12:13.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f4f4c1607f0 addr v1:10.20.193.104:6789/0 2026-02-13T08:12:13.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f4f4c08f310 addr v1:10.20.193.119:6789/0 2026-02-13T08:12:13.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 1 -- 10.20.193.104:0/505938722 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c08ae60 con 0x7f4f4c1607f0 2026-02-13T08:12:13.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f4bfff640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1822f0 legacy=0x7f4f280237f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:13.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 1 -- 10.20.193.104:0/505938722 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c08ab80 con 0x7f4f4c08f310 2026-02-13T08:12:13.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 1 -- 10.20.193.104:0/505938722 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f28069fc0 con 0x7f4f4c1822f0 2026-02-13T08:12:13.508 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.500+0000 7f4f49ffb640 10 monclient(hunting): _renew_subs 2026-02-13T08:12:13.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:13.704+0000 7f4f4bfff640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1822f0 legacy=0x7f4f280237f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:14.111 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:14.107+0000 7f4f4bfff640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1822f0 legacy=0x7f4f280237f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:14.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:14.911+0000 7f4f4bfff640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1822f0 legacy=0x7f4f280237f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:15.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 1 -- 10.20.193.104:0/505938722 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647691298 0 0) 0x7f4f4c08ae60 con 0x7f4f4c1607f0 2026-02-13T08:12:15.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient(hunting): my global_id is 94155 2026-02-13T08:12:15.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 1 -- 10.20.193.104:0/505938722 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f30003620 con 0x7f4f4c1607f0 2026-02-13T08:12:15.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 1 -- 10.20.193.104:0/505938722 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4279222376 0 0) 0x7f4f30003620 con 0x7f4f4c1607f0 2026-02-13T08:12:15.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1822f0 legacy=0x7f4f280237f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:12:15.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.119:6789/0 conn(0x7f4f4c08f310 legacy=0x7f4f280667a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient: _finish_hunting 0 2026-02-13T08:12:15.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 1 monclient: found mon.noname-a 2026-02-13T08:12:15.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:12:15.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 1 -- 10.20.193.104:0/505938722 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2806b2c0 con 0x7f4f4c1607f0 2026-02-13T08:12:15.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient: _finish_auth 0 2026-02-13T08:12:15.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient: _check_auth_tickets 2026-02-13T08:12:15.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:12:15.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 1 -- 10.20.193.104:0/505938722 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4f3c002d20 con 0x7f4f4c1607f0 2026-02-13T08:12:15.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:12:15.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient: dump: 2026-02-13T08:12:15.488 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.488 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 5 monclient: authenticate success, global_id 94155 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 1 -- 10.20.193.104:0/505938722 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f3c002f60 con 0x7f4f4c1607f0 2026-02-13T08:12:15.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 1 -- 10.20.193.104:0/505938722 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4f3c0033a0 con 0x7f4f4c1607f0 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f4affd640 10 monclient: dump: 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.490 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.491 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.491 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 10 monclient: get_monmap_and_config success 2026-02-13T08:12:15.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 4 set_mon_vals no callback set 2026-02-13T08:12:15.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 10 monclient: shutdown 2026-02-13T08:12:15.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:12:15.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 1 -- 10.20.193.104:0/505938722 >> v1:10.20.193.104:6789/0 conn(0x7f4f4c1607f0 legacy=0x7f4f28044fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 1 -- 10.20.193.104:0/505938722 shutdown_connections 2026-02-13T08:12:15.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 1 -- 10.20.193.104:0/505938722 >> 10.20.193.104:0/505938722 conn(0x7f4f4c090750 msgr2=0x7f4f4c08cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:12:15.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 1 -- 10.20.193.104:0/505938722 shutdown_connections 2026-02-13T08:12:15.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 1 -- 10.20.193.104:0/505938722 wait complete. 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 10 monclient: build_initial_monmap 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 10 monclient: monmap: 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 1 librados: starting msgr at 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 1 librados: starting objecter 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 1 Processor -- start 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 1 -- start start 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 1 librados: setting wanted keys 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 1 librados: calling monclient init 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.479+0000 7f4f529db640 10 monclient: init 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient: _reopen_session rank -1 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient(hunting): picked mon.noname-a con 0x7f4f4c08f310 addr v1:10.20.193.104:6789/0 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient(hunting): picked mon.noname-c con 0x7f4f4c1607f0 addr v1:10.20.193.104:6790/0 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient(hunting): picked mon.noname-b con 0x7f4f4c1822f0 addr v1:10.20.193.119:6789/0 2026-02-13T08:12:15.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c161b30 con 0x7f4f4c08f310 2026-02-13T08:12:15.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c1642d0 con 0x7f4f4c1822f0 2026-02-13T08:12:15.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f4c1645b0 con 0x7f4f4c1607f0 2026-02-13T08:12:15.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient(hunting): _renew_subs 2026-02-13T08:12:15.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient(hunting): authenticate will time out at 841.072173s 2026-02-13T08:12:15.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f4b7fe640 1 -- >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1607f0 legacy=0x7f4f4c17b1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:15.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f50f51640 1 --1- >> v1:10.20.193.119:6789/0 conn(0x7f4f4c1822f0 0x7f4f4c14fed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.119:6789/0 says I am v1:10.20.193.104:55466/0 (socket says 10.20.193.104:55466) 2026-02-13T08:12:15.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f50f51640 1 -- 10.20.193.104:0/1007768629 learned_addr learned my addr 10.20.193.104:0/1007768629 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:12:15.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 client.?.objecter ms_handle_connect 0x7f4f4c1822f0 2026-02-13T08:12:15.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:12:15.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 client.?.objecter ms_handle_connect 0x7f4f4c08f310 2026-02-13T08:12:15.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:12:15.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2194500503 0 0) 0x7f4f4c161b30 con 0x7f4f4c08f310 2026-02-13T08:12:15.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient(hunting): my global_id is 94158 2026-02-13T08:12:15.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f1c003620 con 0x7f4f4c08f310 2026-02-13T08:12:15.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3883682102 0 0) 0x7f4f1c003620 con 0x7f4f4c08f310 2026-02-13T08:12:15.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f4c161b30 con 0x7f4f4c08f310 2026-02-13T08:12:15.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4f38002f80 con 0x7f4f4c08f310 2026-02-13T08:12:15.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:12:15.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:12:15.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient(hunting): dump: 2026-02-13T08:12:15.498 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.498 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.498 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.498 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2877587749 0 0) 0x7f4f4c161b30 con 0x7f4f4c08f310 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 >> v1:10.20.193.104:6790/0 conn(0x7f4f4c1607f0 legacy=0x7f4f4c17b1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 >> v1:10.20.193.119:6789/0 conn(0x7f4f4c1822f0 legacy=0x7f4f4c14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient: _finish_hunting 0 2026-02-13T08:12:15.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 monclient: found mon.a 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f4c1635d0 con 0x7f4f4c08f310 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient: _finish_auth 0 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient: _check_auth_tickets 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 5 monclient: authenticate success, global_id 94158 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient: _renew_subs 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 1 -- 10.20.193.104:0/1007768629 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f4c17b900 con 0x7f4f4c08f310 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 client.94158.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:12:15.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient: _renew_subs 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 1 -- 10.20.193.104:0/1007768629 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f4c1515f0 con 0x7f4f4c08f310 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 1 librados: init done 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f38003710 con 0x7f4f4c08f310 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4f38003980 con 0x7f4f4c08f310 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f48ff9640 10 monclient: dump: 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.501 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.502 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.502 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.502 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.502 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.502 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.502 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f4a7fc640 4 set_mon_vals no callback set 2026-02-13T08:12:15.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:12:15.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:12:15.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.483+0000 7f4f529db640 1 -- 10.20.193.104:0/1007768629 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f0c005190 con 0x7f4f4c08f310 2026-02-13T08:12:15.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.487+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f4f38003b20 con 0x7f4f4c08f310 2026-02-13T08:12:15.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.487+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(305..305 src has 1..305) ==== 4365+0+0 (unknown 3171620101 0 0) 0x7f4f3804a4c0 con 0x7f4f4c08f310 2026-02-13T08:12:15.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.487+0000 7f4f48ff9640 10 client.94158.objecter ms_dispatch2 0x7f4f4c000ba0 osd_map(305..305 src has 1..305) 2026-02-13T08:12:15.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.487+0000 7f4f48ff9640 3 client.94158.objecter handle_osd_map got epochs [305,305] > 0 2026-02-13T08:12:15.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.487+0000 7f4f48ff9640 3 client.94158.objecter handle_osd_map decoding full epoch 305 2026-02-13T08:12:15.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.487+0000 7f4f48ff9640 20 client.94158.objecter dump_active .. 0 homeless 2026-02-13T08:12:15.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.487+0000 7f4f4b7fe640 10 monclient: get_auth_request con 0x7f4f1c03b650 auth_method 0 2026-02-13T08:12:15.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.487+0000 7f4f48ff9640 10 client.94158.objecter ms_handle_connect 0x7f4f1c03b650 2026-02-13T08:12:15.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.491+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f4f38016be0 con 0x7f4f4c08f310 2026-02-13T08:12:15.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.491+0000 7f4f48ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:12:15.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.491+0000 7f4f48ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:12:15.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:12:15.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:12:15.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 1 -- 10.20.193.104:0/1007768629 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4f0c005480 con 0x7f4f4c08f310 2026-02-13T08:12:15.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f48ff9640 1 -- 10.20.193.104:0/1007768629 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1469 (unknown 254746657 0 2758558171) 0x7f4f380164e0 con 0x7f4f4c08f310 2026-02-13T08:12:15.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f48ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:12:15.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f48ff9640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:12:15.608 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":48,"quorum":[0,1],"quorum_names":["a","b"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:12:15.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 10 librados: watch_flush enter 2026-02-13T08:12:15.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 10 librados: watch_flush exit 2026-02-13T08:12:15.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 20 client.94158.objecter shutdown clearing up homeless session... 2026-02-13T08:12:15.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 10 client.94158.objecter successfully canceled tick 2026-02-13T08:12:15.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 1 -- 10.20.193.104:0/1007768629 >> v1:10.20.193.119:6812/276487904 conn(0x7f4f1c03b650 legacy=0x7f4f1c05bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 10 monclient: shutdown 2026-02-13T08:12:15.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:12:15.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 1 -- 10.20.193.104:0/1007768629 >> v1:10.20.193.104:6789/0 conn(0x7f4f4c08f310 legacy=0x7f4f4c161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 1 -- 10.20.193.104:0/1007768629 shutdown_connections 2026-02-13T08:12:15.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 1 -- 10.20.193.104:0/1007768629 >> 10.20.193.104:0/1007768629 conn(0x7f4f4c090750 msgr2=0x7f4f4c085e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:12:15.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 1 -- 10.20.193.104:0/1007768629 shutdown_connections 2026-02-13T08:12:15.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 1 -- 10.20.193.104:0/1007768629 wait complete. 2026-02-13T08:12:15.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.603+0000 7f4f529db640 1 librados: shutdown 2026-02-13T08:12:15.619 INFO:tasks.mon_thrash.ceph_manager:quorum is size 2 2026-02-13T08:12:15.619 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon a 2026-02-13T08:12:15.619 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T08:12:15.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 10 monclient: get_monmap_and_config 2026-02-13T08:12:15.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 10 monclient: build_initial_monmap 2026-02-13T08:12:15.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 10 monclient: monmap: 2026-02-13T08:12:15.689 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:12:15.689 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.689 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:12:15.686906+0000 2026-02-13T08:12:15.689 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:12:15.686906+0000 2026-02-13T08:12:15.689 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:12:15.689 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.690 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:12:15.690 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:12:15.690 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:12:15.690 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 1 Processor -- start 2026-02-13T08:12:15.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 1 -- start start 2026-02-13T08:12:15.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 10 monclient: init 2026-02-13T08:12:15.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 10 monclient: _reopen_session rank -1 2026-02-13T08:12:15.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:12:15.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 10 monclient(hunting): picked mon.noname-c con 0x7f2e2813ef60 addr v1:10.20.193.119:6789/0 2026-02-13T08:12:15.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 10 monclient(hunting): picked mon.noname-b con 0x7f2e2813f330 addr v1:10.20.193.104:6790/0 2026-02-13T08:12:15.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 10 monclient(hunting): picked mon.noname-a con 0x7f2e281819c0 addr v1:10.20.193.104:6789/0 2026-02-13T08:12:15.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2813fe80 con 0x7f2e281819c0 2026-02-13T08:12:15.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2805d8f0 con 0x7f2e2813ef60 2026-02-13T08:12:15.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2805e160 con 0x7f2e2813f330 2026-02-13T08:12:15.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 10 monclient(hunting): _renew_subs 2026-02-13T08:12:15.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e2cb46640 10 monclient(hunting): authenticate will time out at 841.275771s 2026-02-13T08:12:15.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e25d74640 1 -- >> v1:10.20.193.104:6790/0 conn(0x7f2e2813f330 legacy=0x7f2e281802a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:15.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e26d76640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f2e281819c0 0x7f2e281a1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:40316/0 (socket says 10.20.193.104:40316) 2026-02-13T08:12:15.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.683+0000 7f2e26d76640 1 -- 10.20.193.104:0/901989798 learned_addr learned my addr 10.20.193.104:0/901989798 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 1 -- 10.20.193.104:0/901989798 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3893514768 0 0) 0x7f2e2813fe80 con 0x7f2e281819c0 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient(hunting): my global_id is 94167 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 1 -- 10.20.193.104:0/901989798 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e14003620 con 0x7f2e281819c0 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 1 -- 10.20.193.104:0/901989798 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1845109222 0 0) 0x7f2e14003620 con 0x7f2e281819c0 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 1 -- 10.20.193.104:0/901989798 >> v1:10.20.193.104:6790/0 conn(0x7f2e2813f330 legacy=0x7f2e281802a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 1 -- 10.20.193.104:0/901989798 >> v1:10.20.193.119:6789/0 conn(0x7f2e2813ef60 legacy=0x7f2e2808c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient: _finish_hunting 0 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 1 monclient: found mon.noname-a 2026-02-13T08:12:15.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 1 -- 10.20.193.104:0/901989798 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e2805d390 con 0x7f2e281819c0 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient: _finish_auth 0 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient: _check_auth_tickets 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 5 monclient: authenticate success, global_id 94167 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 1 -- 10.20.193.104:0/901989798 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2e18003180 con 0x7f2e281819c0 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient: dump: 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.703 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.704 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.704 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.704 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.704 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.704 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.704 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.704 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.704 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:12:15.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 1 -- 10.20.193.104:0/901989798 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e18003400 con 0x7f2e281819c0 2026-02-13T08:12:15.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 1 -- 10.20.193.104:0/901989798 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2e18003840 con 0x7f2e281819c0 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25573640 10 monclient: dump: 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.705 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient: get_monmap_and_config success 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 4 set_mon_vals no callback set 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient: shutdown 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- 10.20.193.104:0/901989798 >> v1:10.20.193.104:6789/0 conn(0x7f2e281819c0 legacy=0x7f2e281a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- 10.20.193.104:0/901989798 shutdown_connections 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- 10.20.193.104:0/901989798 >> 10.20.193.104:0/901989798 conn(0x7f2e2808d040 msgr2=0x7f2e2808d410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- 10.20.193.104:0/901989798 shutdown_connections 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- 10.20.193.104:0/901989798 wait complete. 2026-02-13T08:12:15.706 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient: build_initial_monmap 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient: monmap: 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 librados: starting msgr at 2026-02-13T08:12:15.707 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 librados: starting objecter 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 Processor -- start 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- start start 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 librados: setting wanted keys 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 librados: calling monclient init 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient: init 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient: _reopen_session rank -1 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient(hunting): picked mon.noname-b con 0x7f2e2813ef60 addr v1:10.20.193.119:6789/0 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient(hunting): picked mon.noname-c con 0x7f2e2813f330 addr v1:10.20.193.104:6790/0 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient(hunting): picked mon.noname-a con 0x7f2e281819c0 addr v1:10.20.193.104:6789/0 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e28079a70 con 0x7f2e281819c0 2026-02-13T08:12:15.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e2807ad00 con 0x7f2e2813ef60 2026-02-13T08:12:15.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e28078200 con 0x7f2e2813f330 2026-02-13T08:12:15.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient(hunting): _renew_subs 2026-02-13T08:12:15.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient(hunting): authenticate will time out at 841.277534s 2026-02-13T08:12:15.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25d74640 1 -- >> v1:10.20.193.104:6790/0 conn(0x7f2e2813f330 legacy=0x7f2e28077af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:15.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e26d76640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f2e281819c0 0x7f2e28180eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:40322/0 (socket says 10.20.193.104:40322) 2026-02-13T08:12:15.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e26d76640 1 -- 10.20.193.104:0/2556760470 learned_addr learned my addr 10.20.193.104:0/2556760470 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:12:15.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 client.?.objecter ms_handle_connect 0x7f2e281819c0 2026-02-13T08:12:15.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:12:15.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2039061547 0 0) 0x7f2e28079a70 con 0x7f2e281819c0 2026-02-13T08:12:15.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): my global_id is 94170 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2df4003620 con 0x7f2e281819c0 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 client.?.objecter ms_handle_connect 0x7f2e2813ef60 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1003172791 0 0) 0x7f2df4003620 con 0x7f2e281819c0 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e28079a70 con 0x7f2e281819c0 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2e18003090 con 0x7f2e281819c0 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): dump: 2026-02-13T08:12:15.710 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 213614357 0 0) 0x7f2e2805d8f0 con 0x7f2e2813ef60 2026-02-13T08:12:15.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): my global_id is 74659 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2df4003620 con 0x7f2e2813ef60 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2132093548 0 0) 0x7f2e28079a70 con 0x7f2e281819c0 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 >> v1:10.20.193.104:6790/0 conn(0x7f2e2813f330 legacy=0x7f2e28077af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 >> v1:10.20.193.119:6789/0 conn(0x7f2e2813ef60 legacy=0x7f2e280773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: _finish_hunting 0 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 monclient: found mon.a 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e28078580 con 0x7f2e281819c0 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: _finish_auth 0 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: _check_auth_tickets 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 5 monclient: authenticate success, global_id 94170 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient: _renew_subs 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e2807a8e0 con 0x7f2e281819c0 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 client.94170.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient: _renew_subs 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e28079340 con 0x7f2e281819c0 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 librados: init done 2026-02-13T08:12:15.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e180032a0 con 0x7f2e281819c0 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2e18005210 con 0x7f2e281819c0 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e24d72640 4 set_mon_vals no callback set 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: dump: 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.714 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e2cb46640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2e28061860 con 0x7f2e281815c0 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 client.94170.objecter ms_handle_connect 0x7f2e281815c0 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 client.94170.objecter resend_mon_ops 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2978362511 0 0) 0x7f2e28061860 con 0x7f2e281815c0 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient(hunting): my global_id is 94173 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e28079a70 con 0x7f2e281815c0 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f2e18011220 con 0x7f2e281819c0 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(305..305 src has 1..305) ==== 4365+0+0 (unknown 3171620101 0 0) 0x7f2e1804a7a0 con 0x7f2e281819c0 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 client.94170.objecter ms_dispatch2 0x7f2e28000ba0 osd_map(305..305 src has 1..305) 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 3 client.94170.objecter handle_osd_map got epochs [305,305] > 0 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 3 client.94170.objecter handle_osd_map decoding full epoch 305 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 20 client.94170.objecter dump_active .. 0 homeless 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2213187656 0 0) 0x7f2e28079a70 con 0x7f2e281815c0 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e28061860 con 0x7f2e281815c0 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2e1c002ed0 con 0x7f2e281815c0 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: dump: 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e25d74640 10 monclient: get_auth_request con 0x7f2df403b960 auth_method 0 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3249897611 0 0) 0x7f2e28061860 con 0x7f2e281815c0 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e2807a4b0 con 0x7f2e281815c0 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f2e1c0044e0 con 0x7f2e281815c0 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 >> v1:10.20.193.104:6789/0 conn(0x7f2e281815c0 legacy=0x7f2e280883d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 >> v1:10.20.193.104:6789/0 conn(0x7f2e281815c0 legacy=0x7f2e280883d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.687+0000 7f2e0effd640 10 client.94170.objecter ms_handle_connect 0x7f2df403b960 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2e28087330 con 0x7f2e281a34c0 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 10 client.94170.objecter ms_handle_connect 0x7f2e281a34c0 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 10 client.94170.objecter resend_mon_ops 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1865176822 0 0) 0x7f2e28087330 con 0x7f2e281a34c0 2026-02-13T08:12:15.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 10 monclient(hunting): my global_id is 94176 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e28061860 con 0x7f2e281a34c0 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1513662356 0 0) 0x7f2e28061860 con 0x7f2e281a34c0 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e28087330 con 0x7f2e281a34c0 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2e1c003210 con 0x7f2e281a34c0 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 10 monclient: dump: 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.719 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3629634102 0 0) 0x7f2e28087330 con 0x7f2e281a34c0 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 --> v1:10.20.193.104:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2e280891f0 con 0x7f2e281a34c0 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4315 (unknown 0 0 87292710) 0x7f2e1c003320 con 0x7f2e281a34c0 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 >> v1:10.20.193.104:6789/0 conn(0x7f2e281a34c0 legacy=0x7f2e28088ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e0effd640 1 -- 10.20.193.104:0/2556760470 >> v1:10.20.193.104:6789/0 conn(0x7f2e281a34c0 legacy=0x7f2e28088ae0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:12:15.721 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:12:15.721 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:12:15.721 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:12:15.721 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:12:15.721 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 48, 2026-02-13T08:12:15.721 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 22466, 2026-02-13T08:12:15.721 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:12:15.721 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:12:15.721 INFO:teuthology.orchestra.run.trial104.stdout: 1 2026-02-13T08:12:15.721 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:12:15.722 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:12:15.723 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:12:15.724 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:12:15.725 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:12:15.726 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:12:15.727 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:12:15.728 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:12:15.729 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: "num": 3 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: "num": 2 2026-02-13T08:12:15.730 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.731 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.731 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.731 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:12:15.731 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:12:15.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 10 librados: watch_flush enter 2026-02-13T08:12:15.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 10 librados: watch_flush exit 2026-02-13T08:12:15.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 20 client.94170.objecter shutdown clearing up homeless session... 2026-02-13T08:12:15.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 10 client.94170.objecter successfully canceled tick 2026-02-13T08:12:15.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 1 -- 10.20.193.104:0/2556760470 >> v1:10.20.193.119:6812/276487904 conn(0x7f2df403b960 legacy=0x7f2df405be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 10 monclient: shutdown 2026-02-13T08:12:15.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:12:15.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 1 -- 10.20.193.104:0/2556760470 >> v1:10.20.193.104:6789/0 conn(0x7f2e281819c0 legacy=0x7f2e28180eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e26d76640 1 -- 10.20.193.104:0/2556760470 reap_dead start 2026-02-13T08:12:15.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e26d76640 1 -- 10.20.193.104:0/2556760470 reap_dead start 2026-02-13T08:12:15.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 1 -- 10.20.193.104:0/2556760470 shutdown_connections 2026-02-13T08:12:15.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 1 -- 10.20.193.104:0/2556760470 >> 10.20.193.104:0/2556760470 conn(0x7f2e2808d040 msgr2=0x7f2e280879d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:12:15.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 1 -- 10.20.193.104:0/2556760470 shutdown_connections 2026-02-13T08:12:15.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 1 -- 10.20.193.104:0/2556760470 wait complete. 2026-02-13T08:12:15.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.691+0000 7f2e2cb46640 1 librados: shutdown 2026-02-13T08:12:15.733 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T08:12:15.733 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 2 for mon b 2026-02-13T08:12:15.734 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T08:12:15.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 10 monclient: get_monmap_and_config 2026-02-13T08:12:15.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 10 monclient: build_initial_monmap 2026-02-13T08:12:15.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 10 monclient: monmap: 2026-02-13T08:12:15.792 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:12:15.792 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.792 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:12:15.790395+0000 2026-02-13T08:12:15.793 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:12:15.790395+0000 2026-02-13T08:12:15.793 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:12:15.793 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.793 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:12:15.793 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:12:15.793 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:12:15.793 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 1 Processor -- start 2026-02-13T08:12:15.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 1 -- start start 2026-02-13T08:12:15.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 10 monclient: init 2026-02-13T08:12:15.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 10 monclient: _reopen_session rank -1 2026-02-13T08:12:15.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:12:15.799 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 10 monclient(hunting): picked mon.noname-c con 0x7f3c48139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 10 monclient(hunting): picked mon.noname-a con 0x7f3c4815e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 10 monclient(hunting): picked mon.noname-b con 0x7f3c4817fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4813aa00 con 0x7f3c4815e200 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4808ba20 con 0x7f3c48139f20 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c48089e30 con 0x7f3c4817fd00 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 10 monclient(hunting): _renew_subs 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 10 monclient(hunting): authenticate will time out at 841.379444s 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4dd05640 1 -- >> v1:10.20.193.104:6790/0 conn(0x7f3c4817fd00 legacy=0x7f3c481a00e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4cd03640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f3c4815e200 0x7f3c4817e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:40348/0 (socket says 10.20.193.104:40348) 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4cd03640 1 -- 10.20.193.104:0/280542307 learned_addr learned my addr 10.20.193.104:0/280542307 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 1 -- 10.20.193.104:0/280542307 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1174988117 0 0) 0x7f3c3c002920 con 0x7f3c4815e200 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.800 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient(hunting): my global_id is 94179 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 1 -- 10.20.193.104:0/280542307 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c30003620 con 0x7f3c4815e200 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 1 -- 10.20.193.104:0/280542307 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184794737 0 0) 0x7f3c4808ba20 con 0x7f3c48139f20 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient(hunting): my global_id is 74662 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 1 -- 10.20.193.104:0/280542307 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c3c002920 con 0x7f3c48139f20 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 1 -- 10.20.193.104:0/280542307 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2392720191 0 0) 0x7f3c30003620 con 0x7f3c4815e200 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 1 -- 10.20.193.104:0/280542307 >> v1:10.20.193.104:6790/0 conn(0x7f3c4817fd00 legacy=0x7f3c481a00e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 1 -- 10.20.193.104:0/280542307 >> v1:10.20.193.119:6789/0 conn(0x7f3c48139f20 legacy=0x7f3c4813a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient: _finish_hunting 0 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 1 monclient: found mon.noname-a 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 1 -- 10.20.193.104:0/280542307 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4808a380 con 0x7f3c4815e200 2026-02-13T08:12:15.801 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient: _finish_auth 0 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient: _check_auth_tickets 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 1 -- 10.20.193.104:0/280542307 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3c3c002fd0 con 0x7f3c4815e200 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c37fff640 10 monclient: dump: 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.802 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 5 monclient: authenticate success, global_id 94179 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.787+0000 7f3c4f78f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c37fff640 1 -- 10.20.193.104:0/280542307 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c3c0031e0 con 0x7f3c4815e200 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c37fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c37fff640 1 -- 10.20.193.104:0/280542307 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3c3c0049a0 con 0x7f3c4815e200 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c37fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c37fff640 10 monclient: dump: 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.803 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient: get_monmap_and_config success 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 4 set_mon_vals no callback set 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient: shutdown 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- 10.20.193.104:0/280542307 >> v1:10.20.193.104:6789/0 conn(0x7f3c4815e200 legacy=0x7f3c4817e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- 10.20.193.104:0/280542307 shutdown_connections 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- 10.20.193.104:0/280542307 >> 10.20.193.104:0/280542307 conn(0x7f3c48051a50 msgr2=0x7f3c48051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- 10.20.193.104:0/280542307 shutdown_connections 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- 10.20.193.104:0/280542307 wait complete. 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient: build_initial_monmap 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient: monmap: 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:12:15.804 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 librados: starting msgr at 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 librados: starting objecter 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 Processor -- start 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- start start 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 librados: setting wanted keys 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 librados: calling monclient init 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient: init 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient: _reopen_session rank -1 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient(hunting): picked mon.noname-a con 0x7f3c48139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient(hunting): picked mon.noname-b con 0x7f3c4815e200 addr v1:10.20.193.119:6789/0 2026-02-13T08:12:15.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient(hunting): picked mon.noname-c con 0x7f3c4817fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4805ccb0 con 0x7f3c48139f20 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4815da70 con 0x7f3c4815e200 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c48086620 con 0x7f3c4817fd00 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient(hunting): _renew_subs 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient(hunting): authenticate will time out at 841.381739s 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4dd05640 1 -- >> v1:10.20.193.104:6790/0 conn(0x7f3c4817fd00 legacy=0x7f3c48087780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:10.20.193.104:6790/0 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4d504640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f3c48139f20 0x7f3c48086960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:40356/0 (socket says 10.20.193.104:40356) 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4d504640 1 -- 10.20.193.104:0/960362713 learned_addr learned my addr 10.20.193.104:0/960362713 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 client.?.objecter ms_handle_connect 0x7f3c48139f20 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1670393863 0 0) 0x7f3c3c002920 con 0x7f3c48139f20 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): my global_id is 94182 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c18003620 con 0x7f3c48139f20 2026-02-13T08:12:15.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 client.?.objecter ms_handle_connect 0x7f3c4815e200 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 33939724 0 0) 0x7f3c18003620 con 0x7f3c48139f20 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c3c002920 con 0x7f3c48139f20 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3c38003180 con 0x7f3c48139f20 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): dump: 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.807 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528042797 0 0) 0x7f3c4815da70 con 0x7f3c4815e200 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): my global_id is 74665 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c18003620 con 0x7f3c4815e200 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2195591474 0 0) 0x7f3c3c002920 con 0x7f3c48139f20 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 >> v1:10.20.193.104:6790/0 conn(0x7f3c4817fd00 legacy=0x7f3c48087780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 >> v1:10.20.193.119:6789/0 conn(0x7f3c4815e200 legacy=0x7f3c48087070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 monclient: found mon.a 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c4815d790 con 0x7f3c48139f20 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient: _finish_auth 0 2026-02-13T08:12:15.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 5 monclient: authenticate success, global_id 94182 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient: _renew_subs 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3c4815df00 con 0x7f3c48139f20 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 client.94182.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient: _renew_subs 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3c48128c90 con 0x7f3c48139f20 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 librados: init done 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c38003530 con 0x7f3c48139f20 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3c38003b60 con 0x7f3c48139f20 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c377fe640 4 set_mon_vals no callback set 2026-02-13T08:12:15.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient: dump: 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f3c38003d00 con 0x7f3c48139f20 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4f78f640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3c48061860 con 0x7f3c4817e5e0 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(305..305 src has 1..305) ==== 4365+0+0 (unknown 3171620101 0 0) 0x7f3c3804a590 con 0x7f3c48139f20 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 client.94182.objecter ms_dispatch2 0x7f3c48000ba0 osd_map(305..305 src has 1..305) 2026-02-13T08:12:15.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 3 client.94182.objecter handle_osd_map got epochs [305,305] > 0 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 3 client.94182.objecter handle_osd_map decoding full epoch 305 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 20 client.94182.objecter dump_active .. 0 homeless 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 client.94182.objecter ms_handle_connect 0x7f3c4817e5e0 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 client.94182.objecter resend_mon_ops 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c4dd05640 10 monclient: get_auth_request con 0x7f3c1803b8d0 auth_method 0 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404707962 0 0) 0x7f3c48061860 con 0x7f3c4817e5e0 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient(hunting): my global_id is 74668 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c3c002920 con 0x7f3c4817e5e0 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 client.94182.objecter ms_handle_connect 0x7f3c1803b8d0 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1856913552 0 0) 0x7f3c3c002920 con 0x7f3c4817e5e0 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c48061860 con 0x7f3c4817e5e0 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3c3c002e60 con 0x7f3c4817e5e0 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:12:15.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 10 monclient: dump: 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2279069020 0 0) 0x7f3c48061860 con 0x7f3c4817e5e0 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.791+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.119:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c4813c760 con 0x7f3c4817e5e0 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f3c3c002eb0 con 0x7f3c4817e5e0 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 >> v1:10.20.193.119:6789/0 conn(0x7f3c4817e5e0 legacy=0x7f3c4817e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 >> v1:10.20.193.119:6789/0 conn(0x7f3c4817e5e0 legacy=0x7f3c4817e9b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c4f78f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c4f78f640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3c4817f4c0 con 0x7f3c4817f0c0 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 10 client.94182.objecter ms_handle_connect 0x7f3c4817f0c0 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 10 client.94182.objecter resend_mon_ops 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157241718 0 0) 0x7f3c4817f4c0 con 0x7f3c4817f0c0 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 10 monclient(hunting): my global_id is 74671 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c48061860 con 0x7f3c4817f0c0 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3604567491 0 0) 0x7f3c48061860 con 0x7f3c4817f0c0 2026-02-13T08:12:15.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c4817f4c0 con 0x7f3c4817f0c0 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3c3c003540 con 0x7f3c4817f0c0 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.795+0000 7f3c35ffb640 10 monclient: dump: 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 592410227 0 0) 0x7f3c4817f4c0 con 0x7f3c4817f0c0 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 --> v1:10.20.193.119:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3c48088e20 con 0x7f3c4817f0c0 2026-02-13T08:12:15.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4481 (unknown 0 0 394720796) 0x7f3c3c007160 con 0x7f3c4817f0c0 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c35ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c35ffb640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 >> v1:10.20.193.119:6789/0 conn(0x7f3c4817f0c0 legacy=0x7f3c48129f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c35ffb640 1 -- 10.20.193.104:0/960362713 >> v1:10.20.193.119:6789/0 conn(0x7f3c4817f0c0 legacy=0x7f3c48129f90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 48, 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 272825, 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:12:15.816 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: 1 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:12:15.817 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:12:15.818 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:12:15.819 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:12:15.820 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.821 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.822 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.823 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.824 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: "num": 3 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: "num": 6 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:12:15.825 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:12:15.826 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:12:15.826 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 10 librados: watch_flush enter 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 10 librados: watch_flush exit 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 20 client.94182.objecter shutdown clearing up homeless session... 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 10 client.94182.objecter successfully canceled tick 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 1 -- 10.20.193.104:0/960362713 >> v1:10.20.193.119:6812/276487904 conn(0x7f3c1803b8d0 legacy=0x7f3c1805bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 10 monclient: shutdown 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 1 -- 10.20.193.104:0/960362713 >> v1:10.20.193.104:6789/0 conn(0x7f3c48139f20 legacy=0x7f3c48086960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4dd05640 1 -- 10.20.193.104:0/960362713 reap_dead start 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4dd05640 1 -- 10.20.193.104:0/960362713 reap_dead start 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 1 -- 10.20.193.104:0/960362713 shutdown_connections 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 1 -- 10.20.193.104:0/960362713 >> 10.20.193.104:0/960362713 conn(0x7f3c48051a50 msgr2=0x7f3c4813abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:12:15.827 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 1 -- 10.20.193.104:0/960362713 shutdown_connections 2026-02-13T08:12:15.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 1 -- 10.20.193.104:0/960362713 wait complete. 2026-02-13T08:12:15.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:12:15.799+0000 7f3c4f78f640 1 librados: shutdown 2026-02-13T08:12:15.828 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 2 2026-02-13T08:12:15.828 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-13T08:12:32.472 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7011 ms) 2026-02-13T08:12:32.472 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2026-02-13T08:12:32.472 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (2992 ms) 2026-02-13T08:12:32.472 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2026-02-13T08:12:32.472 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7017 ms) 2026-02-13T08:12:32.472 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2026-02-13T08:12:32.472 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (6989 ms) 2026-02-13T08:12:32.473 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2026-02-13T08:12:32.473 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7000 ms) 2026-02-13T08:12:32.473 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2026-02-13T08:12:32.473 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (26834 ms) 2026-02-13T08:12:32.473 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2026-02-13T08:12:32.473 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7020 ms) 2026-02-13T08:12:32.473 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2026-02-13T08:12:32.473 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (6945 ms) 2026-02-13T08:12:32.473 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (188195 ms total) 2026-02-13T08:12:32.473 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: 2026-02-13T08:12:32.473 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/aio_cancel (0 ms) 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeSubmit/cancel 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeSubmit/cancel (0 ms) 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/aio_cancel 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/aio_cancel (0 ms) 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.BeforeComplete/cancel 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.BeforeComplete/cancel (0 ms) 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/aio_cancel 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/aio_cancel (5 ms) 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ RUN ] LibRadosAio/Cancel.AfterComplete/cancel 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ OK ] LibRadosAio/Cancel.AfterComplete/cancel (0 ms) 2026-02-13T08:12:32.474 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] 6 tests from LibRadosAio/Cancel (5 ms total) 2026-02-13T08:12:32.475 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: 2026-02-13T08:12:32.475 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [----------] Global test environment tear-down 2026-02-13T08:12:32.475 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [==========] 63 tests from 5 test suites ran. (377832 ms total) 2026-02-13T08:12:32.475 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ PASSED ] 62 tests. 2026-02-13T08:12:32.475 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ SKIPPED ] 1 test, listed below: 2026-02-13T08:12:32.475 INFO:tasks.workunit.client.0.trial119.stdout: api_aio_pp: [ SKIPPED ] LibRadosAio.PoolEIOFlag 2026-02-13T08:12:32.478 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.478 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14109 2026-02-13T08:12:32.479 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14109 2026-02-13T08:12:32.479 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.479 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14757 2026-02-13T08:12:32.479 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14757 2026-02-13T08:12:32.479 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.479 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14266 2026-02-13T08:12:32.479 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14266 2026-02-13T08:12:32.479 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.479 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14792 2026-02-13T08:12:32.479 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14792 2026-02-13T08:12:32.479 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14345 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14345 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14654 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14654 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14833 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14833 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14283 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14283 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.480 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14575 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14575 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14743 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14743 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14633 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14633 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14783 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14783 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14525 2026-02-13T08:12:32.481 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14525 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14227 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14227 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14812 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14812 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14461 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14461 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14085 2026-02-13T08:12:32.482 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14085 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14125 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14125 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14389 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14389 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14162 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14162 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14482 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14482 2026-02-13T08:12:32.483 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.484 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14511 2026-02-13T08:12:32.484 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14511 2026-02-13T08:12:32.484 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.484 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14707 2026-02-13T08:12:32.484 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14707 2026-02-13T08:12:32.484 INFO:tasks.workunit.client.0.trial119.stderr:+ for t in "${!pids[@]}" 2026-02-13T08:12:32.484 INFO:tasks.workunit.client.0.trial119.stderr:+ pid=14847 2026-02-13T08:12:32.484 INFO:tasks.workunit.client.0.trial119.stderr:+ wait 14847 2026-02-13T08:12:32.484 INFO:tasks.workunit.client.0.trial119.stderr:+ exit 0 2026-02-13T08:12:32.484 INFO:tasks.workunit.client.0.trial119.stderr:+ cleanup 2026-02-13T08:12:32.484 INFO:tasks.workunit.client.0.trial119.stderr:+ pkill -P 14079 2026-02-13T08:12:32.485 INFO:tasks.workunit.client.0.trial119.stderr:+ true 2026-02-13T08:12:32.486 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T08:12:32.486 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T08:12:32.496 INFO:tasks.workunit:Stopping ['rados/test.sh unit_test_scan'] on client.0... 2026-02-13T08:12:32.496 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-13T08:12:32.844 DEBUG:teuthology.parallel:result is None 2026-02-13T08:12:32.845 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-13T08:12:32.853 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-13T08:12:32.853 DEBUG:teuthology.orchestra.run.trial119:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-13T08:12:32.899 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-13T08:12:32.899 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-13T08:12:32.916 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-13T08:13:45.829 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-13T08:13:45.829 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-13T08:13:45.830 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-13T08:13:45.832 INFO:tasks.ceph.mon.c:Started 2026-02-13T08:13:45.832 INFO:tasks.mon_thrash:Sending STOP to mon a 2026-02-13T08:13:45.832 INFO:tasks.ceph.mon.a:Sent signal 19 2026-02-13T08:13:45.832 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-13T08:14:00.833 INFO:tasks.mon_thrash:Sending CONT to mon a 2026-02-13T08:14:00.834 INFO:tasks.ceph.mon.a:Sent signal 18 2026-02-13T08:14:00.834 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T08:14:00.835 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:14:00.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 10 monclient: get_monmap_and_config 2026-02-13T08:14:00.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 10 monclient: build_initial_monmap 2026-02-13T08:14:00.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 10 monclient: monmap: 2026-02-13T08:14:00.906 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:00.906 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:00.906 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:00.901942+0000 2026-02-13T08:14:00.906 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:00.901942+0000 2026-02-13T08:14:00.906 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:00.906 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:00.906 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:00.906 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:00.906 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:00.906 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:00.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 1 Processor -- start 2026-02-13T08:14:00.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 1 -- start start 2026-02-13T08:14:00.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 10 monclient: init 2026-02-13T08:14:00.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:00.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:14:00.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 10 monclient(hunting): picked mon.noname-a con 0x7f165408e4b0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:00.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 10 monclient(hunting): picked mon.noname-b con 0x7f165408ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:00.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 10 monclient(hunting): picked mon.noname-c con 0x7f165417fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:00.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1654089fa0 con 0x7f165408e4b0 2026-02-13T08:14:00.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1654089760 con 0x7f165417fe50 2026-02-13T08:14:00.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165408af90 con 0x7f165408ef90 2026-02-13T08:14:00.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:00.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f165c0a3640 10 monclient(hunting): authenticate will time out at 946.490853s 2026-02-13T08:14:00.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f1659e18640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f165408e4b0 0x7f165408e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44770/0 (socket says 10.20.193.104:44770) 2026-02-13T08:14:00.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.896+0000 7f1659e18640 1 -- 10.20.193.104:0/1559158597 learned_addr learned my addr 10.20.193.104:0/1559158597 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:00.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 1 -- 10.20.193.104:0/1559158597 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353922873 0 0) 0x7f165408af90 con 0x7f165408ef90 2026-02-13T08:14:00.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient(hunting): _negotiate 2026-02-13T08:14:00.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:00.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:00.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient(hunting): my global_id is 104099 2026-02-13T08:14:00.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 1 -- 10.20.193.104:0/1559158597 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f163c003620 con 0x7f165408ef90 2026-02-13T08:14:00.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 1 -- 10.20.193.104:0/1559158597 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1297420450 0 0) 0x7f163c003620 con 0x7f165408ef90 2026-02-13T08:14:00.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 1 -- 10.20.193.104:0/1559158597 >> v1:10.20.193.119:6789/0 conn(0x7f165417fe50 legacy=0x7f16541a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:00.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 1 -- 10.20.193.104:0/1559158597 >> v1:10.20.193.104:6789/0 conn(0x7f165408e4b0 legacy=0x7f165408e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:00.923 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient: _finish_hunting 0 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 1 monclient: found mon.noname-b 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 1 -- 10.20.193.104:0/1559158597 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165408b270 con 0x7f165408ef90 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient: _finish_auth 0 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient: _check_auth_tickets 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 1 -- 10.20.193.104:0/1559158597 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1648002e00 con 0x7f165408ef90 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient: dump: 2026-02-13T08:14:00.924 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 5 monclient: authenticate success, global_id 104099 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:00.925 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 1 -- 10.20.193.104:0/1559158597 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1648003080 con 0x7f165408ef90 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 1 -- 10.20.193.104:0/1559158597 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f16480034c0 con 0x7f165408ef90 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f1658e16640 10 monclient: dump: 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:00.926 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 4 set_mon_vals no callback set 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient: shutdown 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 -- 10.20.193.104:0/1559158597 >> v1:10.20.193.104:6790/0 conn(0x7f165408ef90 legacy=0x7f165417e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 -- 10.20.193.104:0/1559158597 shutdown_connections 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 -- 10.20.193.104:0/1559158597 >> 10.20.193.104:0/1559158597 conn(0x7f1654051e80 msgr2=0x7f165408c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 -- 10.20.193.104:0/1559158597 shutdown_connections 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 -- 10.20.193.104:0/1559158597 wait complete. 2026-02-13T08:14:00.927 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient: build_initial_monmap 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient: monmap: 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:00.928 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 librados: starting msgr at 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 librados: starting objecter 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 Processor -- start 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 -- start start 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 librados: setting wanted keys 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 librados: calling monclient init 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient: init 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient(hunting): picked mon.noname-b con 0x7f165408e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient(hunting): picked mon.noname-c con 0x7f165408ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient(hunting): picked mon.noname-a con 0x7f165417fe50 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:00.929 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f165405cbd0 con 0x7f165417fe50 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16541877d0 con 0x7f165408e4b0 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1654087880 con 0x7f165408ef90 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165c0a3640 10 monclient(hunting): authenticate will time out at 946.503727s 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165a619640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f165417fe50 0x7f165419dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44778/0 (socket says 10.20.193.104:44778) 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f165a619640 1 -- 10.20.193.104:0/2889630801 learned_addr learned my addr 10.20.193.104:0/2889630801 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f16427fc640 10 client.?.objecter ms_handle_connect 0x7f165417fe50 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f16427fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f16427fc640 10 client.?.objecter ms_handle_connect 0x7f165408ef90 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f16427fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f16427fc640 10 client.?.objecter ms_handle_connect 0x7f165408e4b0 2026-02-13T08:14:00.930 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.908+0000 7f16427fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2039960933 0 0) 0x7f1654087880 con 0x7f165408ef90 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient(hunting): my global_id is 104102 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1624003620 con 0x7f165408ef90 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 634584988 0 0) 0x7f1624003620 con 0x7f165408ef90 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1654087880 con 0x7f165408ef90 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1648002d10 con 0x7f165408ef90 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:00.931 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient(hunting): dump: 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:00.932 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2798648431 0 0) 0x7f1654087880 con 0x7f165408ef90 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 >> v1:10.20.193.119:6789/0 conn(0x7f165408e4b0 legacy=0x7f1654086a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 >> v1:10.20.193.104:6789/0 conn(0x7f165417fe50 legacy=0x7f165419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient: _finish_hunting 0 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 monclient: found mon.c 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1654086790 con 0x7f165408ef90 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient: _finish_auth 0 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient: _check_auth_tickets 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 5 monclient: authenticate success, global_id 104102 2026-02-13T08:14:00.933 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 10 monclient: _renew_subs 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 1 -- 10.20.193.104:0/2889630801 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f16540884f0 con 0x7f165408ef90 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 10 client.104102.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 10 monclient: _renew_subs 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 1 -- 10.20.193.104:0/2889630801 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1654185cb0 con 0x7f165408ef90 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 1 librados: init done 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1648003a60 con 0x7f165408ef90 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f1648003c10 con 0x7f165408ef90 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:00.934 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 monclient: dump: 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f1643fff640 4 set_mon_vals no callback set 2026-02-13T08:14:00.935 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:00.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:00.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:00.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f165c0a3640 1 -- 10.20.193.104:0/2889630801 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1654061860 con 0x7f165408ef90 2026-02-13T08:14:00.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f164800fc20 con 0x7f165408ef90 2026-02-13T08:14:00.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f1648049310 con 0x7f165408ef90 2026-02-13T08:14:00.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 client.104102.objecter ms_dispatch2 0x7f1654000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:00.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 3 client.104102.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:00.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 3 client.104102.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:00.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 20 client.104102.objecter dump_active .. 0 homeless 2026-02-13T08:14:00.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f1659e18640 10 monclient: get_auth_request con 0x7f162403b760 auth_method 0 2026-02-13T08:14:00.936 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.912+0000 7f16427fc640 10 client.104102.objecter ms_handle_connect 0x7f162403b760 2026-02-13T08:14:00.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.916+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f1648015b50 con 0x7f165408ef90 2026-02-13T08:14:00.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.916+0000 7f16427fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:00.937 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:00.916+0000 7f16427fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:01.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.024+0000 7f165c0a3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:14:01.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.024+0000 7f165c0a3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:14:01.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.024+0000 7f165c0a3640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.024+0000 7f165c0a3640 1 -- 10.20.193.104:0/2889630801 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f165408cc70 con 0x7f165408ef90 2026-02-13T08:14:01.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.024+0000 7f16427fc640 1 -- 10.20.193.104:0/2889630801 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1475 (unknown 254746657 0 2397042306) 0x7f1648015450 con 0x7f165408ef90 2026-02-13T08:14:01.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.024+0000 7f16427fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:14:01.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.024+0000 7f16427fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:14:01.035 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:14:01.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 10 librados: watch_flush enter 2026-02-13T08:14:01.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 10 librados: watch_flush exit 2026-02-13T08:14:01.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 20 client.104102.objecter shutdown clearing up homeless session... 2026-02-13T08:14:01.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 10 client.104102.objecter successfully canceled tick 2026-02-13T08:14:01.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 1 -- 10.20.193.104:0/2889630801 >> v1:10.20.193.119:6812/276487904 conn(0x7f162403b760 legacy=0x7f162405bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 10 monclient: shutdown 2026-02-13T08:14:01.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:01.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 1 -- 10.20.193.104:0/2889630801 >> v1:10.20.193.104:6790/0 conn(0x7f165408ef90 legacy=0x7f1654087170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 1 -- 10.20.193.104:0/2889630801 shutdown_connections 2026-02-13T08:14:01.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 1 -- 10.20.193.104:0/2889630801 >> 10.20.193.104:0/2889630801 conn(0x7f1654051e80 msgr2=0x7f165405bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:01.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 1 -- 10.20.193.104:0/2889630801 shutdown_connections 2026-02-13T08:14:01.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 1 -- 10.20.193.104:0/2889630801 wait complete. 2026-02-13T08:14:01.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.028+0000 7f165c0a3640 1 librados: shutdown 2026-02-13T08:14:01.046 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T08:14:01.046 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon a 2026-02-13T08:14:01.047 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-13T08:14:01.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.104+0000 7f02bc168640 10 monclient: get_monmap_and_config 2026-02-13T08:14:01.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.104+0000 7f02bc168640 10 monclient: build_initial_monmap 2026-02-13T08:14:01.115 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.104+0000 7f02bc168640 10 monclient: monmap: 2026-02-13T08:14:01.115 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:01.115 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.115 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:01.111812+0000 2026-02-13T08:14:01.115 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:01.111812+0000 2026-02-13T08:14:01.115 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:01.116 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.116 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:01.116 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:01.116 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:01.116 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 Processor -- start 2026-02-13T08:14:01.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- start start 2026-02-13T08:14:01.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: init 2026-02-13T08:14:01.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient(hunting): picked mon.noname-a con 0x7f02b4139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient(hunting): picked mon.noname-c con 0x7f02b415e200 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient(hunting): picked mon.noname-b con 0x7f02b417fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b413aa00 con 0x7f02b4139f20 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b408ba20 con 0x7f02b415e200 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b4089e30 con 0x7f02b417fd00 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient(hunting): authenticate will time out at 946.700525s 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b9edd640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f02b4139f20 0x7f02b413a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44790/0 (socket says 10.20.193.104:44790) 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b9edd640 1 -- 10.20.193.104:0/3550893334 learned_addr learned my addr 10.20.193.104:0/3550893334 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:01.126 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02ba6de640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f02b417fd00 0x7f02b41a00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57544/0 (socket says 10.20.193.104:57544) 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 -- 10.20.193.104:0/3550893334 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211628136 0 0) 0x7f02b4089e30 con 0x7f02b417fd00 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient(hunting): my global_id is 104105 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 -- 10.20.193.104:0/3550893334 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f029c003620 con 0x7f02b417fd00 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 -- 10.20.193.104:0/3550893334 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354269803 0 0) 0x7f02a4002850 con 0x7f02b4139f20 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient(hunting): my global_id is 94194 2026-02-13T08:14:01.127 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 -- 10.20.193.104:0/3550893334 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b4089e30 con 0x7f02b4139f20 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 -- 10.20.193.104:0/3550893334 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2480067580 0 0) 0x7f029c003620 con 0x7f02b417fd00 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 -- 10.20.193.104:0/3550893334 >> v1:10.20.193.119:6789/0 conn(0x7f02b415e200 legacy=0x7f02b417e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 -- 10.20.193.104:0/3550893334 >> v1:10.20.193.104:6789/0 conn(0x7f02b4139f20 legacy=0x7f02b413a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient: _finish_hunting 0 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 monclient: found mon.noname-b 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 -- 10.20.193.104:0/3550893334 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b408a380 con 0x7f02b417fd00 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient: _finish_auth 0 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient: _check_auth_tickets 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 -- 10.20.193.104:0/3550893334 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f02b0003180 con 0x7f02b417fd00 2026-02-13T08:14:01.128 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient: dump: 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.129 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 5 monclient: authenticate success, global_id 104105 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 -- 10.20.193.104:0/3550893334 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02b0003350 con 0x7f02b417fd00 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 1 -- 10.20.193.104:0/3550893334 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f02b0003790 con 0x7f02b417fd00 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b8edb640 10 monclient: dump: 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.130 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 4 set_mon_vals no callback set 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: shutdown 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- 10.20.193.104:0/3550893334 >> v1:10.20.193.104:6790/0 conn(0x7f02b417fd00 legacy=0x7f02b41a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- 10.20.193.104:0/3550893334 shutdown_connections 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- 10.20.193.104:0/3550893334 >> 10.20.193.104:0/3550893334 conn(0x7f02b4051a50 msgr2=0x7f02b4051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:01.131 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- 10.20.193.104:0/3550893334 shutdown_connections 2026-02-13T08:14:01.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- 10.20.193.104:0/3550893334 wait complete. 2026-02-13T08:14:01.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: build_initial_monmap 2026-02-13T08:14:01.132 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: monmap: 2026-02-13T08:14:01.132 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:01.132 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:01.132 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:01.132 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:01.132 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:01.132 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.132 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:01.132 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 librados: starting msgr at 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 librados: starting objecter 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 Processor -- start 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- start start 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 librados: setting wanted keys 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 librados: calling monclient init 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: init 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient(hunting): picked mon.noname-a con 0x7f02b4139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:01.133 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient(hunting): picked mon.noname-c con 0x7f02b415e200 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient(hunting): picked mon.noname-b con 0x7f02b417fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b4162ab0 con 0x7f02b4139f20 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b4162d90 con 0x7f02b417fd00 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02b417ed30 con 0x7f02b415e200 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient(hunting): authenticate will time out at 946.703092s 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b96dc640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f02b415e200 0x7f02b417e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57554/0 (socket says 10.20.193.104:57554) 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02b96dc640 1 -- 10.20.193.104:0/822885463 learned_addr learned my addr 10.20.193.104:0/822885463 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 client.?.objecter ms_handle_connect 0x7f02b415e200 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 client.?.objecter ms_handle_connect 0x7f02b4139f20 2026-02-13T08:14:01.134 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074365363 0 0) 0x7f02b417ed30 con 0x7f02b415e200 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): my global_id is 104108 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0284003620 con 0x7f02b415e200 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653380211 0 0) 0x7f02b4162ab0 con 0x7f02b4139f20 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): my global_id is 94197 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b417ed30 con 0x7f02b4139f20 2026-02-13T08:14:01.135 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2437771381 0 0) 0x7f0284003620 con 0x7f02b415e200 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02b4162ab0 con 0x7f02b415e200 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f02a8003170 con 0x7f02b415e200 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): dump: 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.136 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3916872162 0 0) 0x7f02b4162ab0 con 0x7f02b415e200 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 >> v1:10.20.193.119:6789/0 conn(0x7f02b417fd00 legacy=0x7f02b4127ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 >> v1:10.20.193.104:6789/0 conn(0x7f02b4139f20 legacy=0x7f02b417df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient: _finish_hunting 0 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 monclient: found mon.c 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02b4161f20 con 0x7f02b415e200 2026-02-13T08:14:01.137 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient: _finish_auth 0 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient: _check_auth_tickets 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 client.?.objecter ms_handle_connect 0x7f02b417fd00 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 5 monclient: authenticate success, global_id 104108 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: _renew_subs 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f02b4160a30 con 0x7f02b415e200 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 client.104108.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: _renew_subs 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f02b415f1e0 con 0x7f02b415e200 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 librados: init done 2026-02-13T08:14:01.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02a8003310 con 0x7f02b415e200 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f02a8003b60 con 0x7f02b415e200 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a27fc640 10 monclient: dump: 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.139 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02a3fff640 4 set_mon_vals no callback set 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.108+0000 7f02bc168640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f02b4161960 con 0x7f02b4161590 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f02a8003d00 con 0x7f02b415e200 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 client.104108.objecter ms_handle_connect 0x7f02b4161590 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 client.104108.objecter resend_mon_ops 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f02a804a5c0 con 0x7f02b415e200 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 client.104108.objecter ms_dispatch2 0x7f02b4000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:01.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 3 client.104108.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 3 client.104108.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 20 client.104108.objecter dump_active .. 0 homeless 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 28417125 0 0) 0x7f02b4161960 con 0x7f02b4161590 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 monclient(hunting): my global_id is 94200 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b4162ab0 con 0x7f02b4161590 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02ba6de640 10 monclient: get_auth_request con 0x7f028403b470 auth_method 0 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1646146658 0 0) 0x7f02b4162ab0 con 0x7f02b4161590 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02b4161960 con 0x7f02b4161590 2026-02-13T08:14:01.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f02a4004a80 con 0x7f02b4161590 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 monclient: dump: 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.142 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4164158713 0 0) 0x7f02b4161960 con 0x7f02b4161590 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02b4088950 con 0x7f02b4161590 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 client.104108.objecter ms_handle_connect 0x7f028403b470 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f02a4004a40 con 0x7f02b4161590 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 >> v1:10.20.193.104:6789/0 conn(0x7f02b4161590 legacy=0x7f02b4058cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.112+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 >> v1:10.20.193.104:6789/0 conn(0x7f02b4161590 legacy=0x7f02b4058cc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f02b40380f0 con 0x7f02b40593d0 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 10 client.104108.objecter ms_handle_connect 0x7f02b40593d0 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 10 client.104108.objecter resend_mon_ops 2026-02-13T08:14:01.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9848069 0 0) 0x7f02b40380f0 con 0x7f02b40593d0 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 10 monclient(hunting): my global_id is 94203 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b4161960 con 0x7f02b40593d0 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1866489014 0 0) 0x7f02b4161960 con 0x7f02b40593d0 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02b40380f0 con 0x7f02b40593d0 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f02a40050d0 con 0x7f02b40593d0 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 10 monclient: dump: 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.144 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 881101537 0 0) 0x7f02b40380f0 con 0x7f02b40593d0 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 --> v1:10.20.193.104:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f02b41625a0 con 0x7f02b40593d0 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 <== mon.0 v1:10.20.193.104:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4327 (unknown 0 0 2692062475) 0x7f02a40073d0 con 0x7f02b40593d0 2026-02-13T08:14:01.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:14:01.146 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:14:01.146 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 >> v1:10.20.193.104:6789/0 conn(0x7f02b40593d0 legacy=0x7f02b4087940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.146 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02a27fc640 1 -- 10.20.193.104:0/822885463 >> v1:10.20.193.104:6789/0 conn(0x7f02b40593d0 legacy=0x7f02b4087940 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:14:01.146 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:14:01.146 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:14:01.146 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:14:01.146 INFO:teuthology.orchestra.run.trial104.stdout: "state": "leader", 2026-02-13T08:14:01.147 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 54, 2026-02-13T08:14:01.147 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 127891, 2026-02-13T08:14:01.147 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:14:01.147 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:14:01.147 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:14:01.147 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:14:01.147 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.147 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:14:01.147 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:14:01.147 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:14:01.147 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:14:01.148 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:14:01.148 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:14:01.148 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:14:01.148 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:14:01.148 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:14:01.148 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:14:01.148 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:14:01.148 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:14:01.148 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:14:01.148 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:14:01.149 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:14:01.150 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:14:01.151 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:14:01.152 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:14:01.153 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:14:01.154 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.155 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:14:01.156 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: "num": 3 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.157 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:14:01.158 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:14:01.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 10 librados: watch_flush enter 2026-02-13T08:14:01.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 10 librados: watch_flush exit 2026-02-13T08:14:01.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 20 client.104108.objecter shutdown clearing up homeless session... 2026-02-13T08:14:01.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 10 client.104108.objecter successfully canceled tick 2026-02-13T08:14:01.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 1 -- 10.20.193.104:0/822885463 >> v1:10.20.193.119:6812/276487904 conn(0x7f028403b470 legacy=0x7f028405b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 10 monclient: shutdown 2026-02-13T08:14:01.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:01.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 1 -- 10.20.193.104:0/822885463 >> v1:10.20.193.104:6790/0 conn(0x7f02b415e200 legacy=0x7f02b417e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02ba6de640 1 -- 10.20.193.104:0/822885463 reap_dead start 2026-02-13T08:14:01.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 1 -- 10.20.193.104:0/822885463 shutdown_connections 2026-02-13T08:14:01.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 1 -- 10.20.193.104:0/822885463 >> 10.20.193.104:0/822885463 conn(0x7f02b4051a50 msgr2=0x7f02b413abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:01.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 1 -- 10.20.193.104:0/822885463 shutdown_connections 2026-02-13T08:14:01.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 1 -- 10.20.193.104:0/822885463 wait complete. 2026-02-13T08:14:01.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.116+0000 7f02bc168640 1 librados: shutdown 2026-02-13T08:14:01.160 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:14:01.160 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon c 2026-02-13T08:14:01.160 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.216+0000 7f630cfde640 10 monclient: get_monmap_and_config 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.216+0000 7f630cfde640 10 monclient: build_initial_monmap 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.216+0000 7f630cfde640 10 monclient: monmap: 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:01.223672+0000 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:01.223672+0000 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:01.227 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 Processor -- start 2026-02-13T08:14:01.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- start start 2026-02-13T08:14:01.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: init 2026-02-13T08:14:01.234 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient(hunting): picked mon.noname-c con 0x7f6308139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient(hunting): picked mon.noname-a con 0x7f630815e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient(hunting): picked mon.noname-b con 0x7f630817fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f630813aa00 con 0x7f630815e200 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f630808ba20 con 0x7f6308139f20 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6308089e30 con 0x7f630817fd00 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient(hunting): authenticate will time out at 946.812654s 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305d74640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f630815e200 0x7f630817e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44836/0 (socket says 10.20.193.104:44836) 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305d74640 1 -- 10.20.193.104:0/841023329 learned_addr learned my addr 10.20.193.104:0/841023329 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6306d76640 1 --1- 10.20.193.104:0/841023329 >> v1:10.20.193.104:6790/0 conn(0x7f630817fd00 0x7f63081a00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57562/0 (socket says 10.20.193.104:57562) 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2431460020 0 0) 0x7f6308089e30 con 0x7f630817fd00 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.235 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): my global_id is 104111 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f4003620 con 0x7f630817fd00 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130553772 0 0) 0x7f62f0002920 con 0x7f630815e200 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): my global_id is 94206 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6308089e30 con 0x7f630815e200 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1152897436 0 0) 0x7f630808ba20 con 0x7f6308139f20 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient(hunting): my global_id is 74689 2026-02-13T08:14:01.236 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f0002920 con 0x7f6308139f20 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1928389185 0 0) 0x7f62f4003620 con 0x7f630817fd00 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 >> v1:10.20.193.119:6789/0 conn(0x7f6308139f20 legacy=0x7f630813a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 >> v1:10.20.193.104:6789/0 conn(0x7f630815e200 legacy=0x7f630817e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient: _finish_hunting 0 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 monclient: found mon.noname-b 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630808a380 con 0x7f630817fd00 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient: _finish_auth 0 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient: _check_auth_tickets 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f62f80030b0 con 0x7f630817fd00 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient: dump: 2026-02-13T08:14:01.237 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 5 monclient: authenticate success, global_id 104111 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62f8003250 con 0x7f630817fd00 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 1 -- 10.20.193.104:0/841023329 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f62f8003690 con 0x7f630817fd00 2026-02-13T08:14:01.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6305573640 10 monclient: dump: 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 4 set_mon_vals no callback set 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: shutdown 2026-02-13T08:14:01.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- 10.20.193.104:0/841023329 >> v1:10.20.193.104:6790/0 conn(0x7f630817fd00 legacy=0x7f63081a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- 10.20.193.104:0/841023329 shutdown_connections 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- 10.20.193.104:0/841023329 >> 10.20.193.104:0/841023329 conn(0x7f6308051a50 msgr2=0x7f6308051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- 10.20.193.104:0/841023329 shutdown_connections 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- 10.20.193.104:0/841023329 wait complete. 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: build_initial_monmap 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: monmap: 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:01.240 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 librados: starting msgr at 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 librados: starting objecter 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 Processor -- start 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- start start 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 librados: setting wanted keys 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 librados: calling monclient init 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: init 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient(hunting): picked mon.noname-a con 0x7f6308139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient(hunting): picked mon.noname-b con 0x7f630815e200 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient(hunting): picked mon.noname-c con 0x7f630817fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6308086620 con 0x7f6308139f20 2026-02-13T08:14:01.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63081604c0 con 0x7f630815e200 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f630805cc60 con 0x7f630817fd00 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient(hunting): authenticate will time out at 946.814609s 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6306575640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f6308139f20 0x7f630817f350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44846/0 (socket says 10.20.193.104:44846) 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6306575640 1 -- 10.20.193.104:0/4185343627 learned_addr learned my addr 10.20.193.104:0/4185343627 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 client.?.objecter ms_handle_connect 0x7f6308139f20 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 client.?.objecter ms_handle_connect 0x7f630817fd00 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2006668791 0 0) 0x7f62f0002920 con 0x7f6308139f20 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): my global_id is 94209 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62d4003620 con 0x7f6308139f20 2026-02-13T08:14:01.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479995134 0 0) 0x7f630805cc60 con 0x7f630817fd00 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): my global_id is 104114 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f0002920 con 0x7f630817fd00 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 client.?.objecter ms_handle_connect 0x7f630815e200 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 554363344 0 0) 0x7f62d4003620 con 0x7f6308139f20 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f630805cc60 con 0x7f6308139f20 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f62fc003180 con 0x7f6308139f20 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): dump: 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.243 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1961319870 0 0) 0x7f62f0002920 con 0x7f630817fd00 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62d4003620 con 0x7f630817fd00 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f62f80035a0 con 0x7f630817fd00 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): dump: 2026-02-13T08:14:01.244 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182200310 0 0) 0x7f63081604c0 con 0x7f630815e200 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient(hunting): my global_id is 74692 2026-02-13T08:14:01.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f0002920 con 0x7f630815e200 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 950225916 0 0) 0x7f62d4003620 con 0x7f630817fd00 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 >> v1:10.20.193.119:6789/0 conn(0x7f630815e200 legacy=0x7f6308125a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 >> v1:10.20.193.104:6789/0 conn(0x7f6308139f20 legacy=0x7f630817f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient: _finish_hunting 0 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 monclient: found mon.c 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630813c770 con 0x7f630817fd00 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient: _finish_auth 0 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient: _check_auth_tickets 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 5 monclient: authenticate success, global_id 104114 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: _renew_subs 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6308160a80 con 0x7f630817fd00 2026-02-13T08:14:01.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 client.104114.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: _renew_subs 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f630817fa60 con 0x7f630817fd00 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 librados: init done 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62f8003180 con 0x7f630817fd00 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f62f8004f10 con 0x7f630817fd00 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 monclient: dump: 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.247 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f6304d72640 4 set_mon_vals no callback set 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f630cfde640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6308087d10 con 0x7f6308087940 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 client.104114.objecter ms_handle_connect 0x7f6308087940 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 10 client.104114.objecter resend_mon_ops 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.220+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f62f8010f20 con 0x7f630817fd00 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f62f804a690 con 0x7f630817fd00 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 client.104114.objecter ms_dispatch2 0x7f6308000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:01.248 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 3 client.104114.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 3 client.104114.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 20 client.104114.objecter dump_active .. 0 homeless 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1462781341 0 0) 0x7f6308087d10 con 0x7f6308087940 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient(hunting): my global_id is 104117 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62d4003620 con 0x7f6308087940 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f6305d74640 10 monclient: get_auth_request con 0x7f62d403b9c0 auth_method 0 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1971569120 0 0) 0x7f62d4003620 con 0x7f6308087940 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6308087d10 con 0x7f6308087940 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f62fc003dd0 con 0x7f6308087940 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:01.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient: dump: 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2538072227 0 0) 0x7f6308087d10 con 0x7f6308087940 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6308160860 con 0x7f6308087940 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 client.104114.objecter ms_handle_connect 0x7f62d403b9c0 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f62fc0058c0 con 0x7f6308087940 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:01.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:01.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 >> v1:10.20.193.104:6790/0 conn(0x7f6308087940 legacy=0x7f6308058890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.251 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 >> v1:10.20.193.104:6790/0 conn(0x7f6308087940 legacy=0x7f6308058890 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:14:01.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f630cfde640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:14:01.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f630cfde640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f63080380f0 con 0x7f6308058fa0 2026-02-13T08:14:01.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 client.104114.objecter ms_handle_connect 0x7f6308058fa0 2026-02-13T08:14:01.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 client.104114.objecter resend_mon_ops 2026-02-13T08:14:01.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3290332830 0 0) 0x7f63080380f0 con 0x7f6308058fa0 2026-02-13T08:14:01.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.252 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 10 monclient(hunting): my global_id is 104120 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.224+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6308087d10 con 0x7f6308058fa0 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2040702325 0 0) 0x7f6308087d10 con 0x7f6308058fa0 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63080380f0 con 0x7f6308058fa0 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f62fc0042e0 con 0x7f6308058fa0 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 10 monclient: dump: 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.253 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.254 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.254 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1258190285 0 0) 0x7f63080380f0 con 0x7f6308058fa0 2026-02-13T08:14:01.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 --> v1:10.20.193.104:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6308088e20 con 0x7f6308058fa0 2026-02-13T08:14:01.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 <== mon.2 v1:10.20.193.104:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4157 (unknown 0 0 2542809610) 0x7f62fc004400 con 0x7f6308058fa0 2026-02-13T08:14:01.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:14:01.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:14:01.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 >> v1:10.20.193.104:6790/0 conn(0x7f6308058fa0 legacy=0x7f63081298e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.254 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f62eeffd640 1 -- 10.20.193.104:0/4185343627 >> v1:10.20.193.104:6790/0 conn(0x7f6308058fa0 legacy=0x7f63081298e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:14:01.254 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:14:01.254 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 54, 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 15363, 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:14:01.255 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:14:01.256 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:14:01.257 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:14:01.258 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.259 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.260 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.261 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.262 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: "num": 2 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:14:01.263 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 10 librados: watch_flush enter 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 10 librados: watch_flush exit 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 20 client.104114.objecter shutdown clearing up homeless session... 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 10 client.104114.objecter successfully canceled tick 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 1 -- 10.20.193.104:0/4185343627 >> v1:10.20.193.119:6812/276487904 conn(0x7f62d403b9c0 legacy=0x7f62d405be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 10 monclient: shutdown 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 1 -- 10.20.193.104:0/4185343627 >> v1:10.20.193.104:6790/0 conn(0x7f630817fd00 legacy=0x7f63081271b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f6306d76640 1 -- 10.20.193.104:0/4185343627 reap_dead start 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f6306d76640 1 -- 10.20.193.104:0/4185343627 reap_dead start 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 1 -- 10.20.193.104:0/4185343627 shutdown_connections 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 1 -- 10.20.193.104:0/4185343627 >> 10.20.193.104:0/4185343627 conn(0x7f6308051a50 msgr2=0x7f630813cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 1 -- 10.20.193.104:0/4185343627 shutdown_connections 2026-02-13T08:14:01.265 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 1 -- 10.20.193.104:0/4185343627 wait complete. 2026-02-13T08:14:01.266 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.228+0000 7f630cfde640 1 librados: shutdown 2026-02-13T08:14:01.266 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:14:01.266 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 3 for mon b 2026-02-13T08:14:01.266 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-13T08:14:01.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.324+0000 7f977d224640 10 monclient: get_monmap_and_config 2026-02-13T08:14:01.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.324+0000 7f977d224640 10 monclient: build_initial_monmap 2026-02-13T08:14:01.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.324+0000 7f977d224640 10 monclient: monmap: 2026-02-13T08:14:01.334 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:01.335 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.335 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:01.331437+0000 2026-02-13T08:14:01.335 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:01.331437+0000 2026-02-13T08:14:01.335 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:01.335 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.335 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:01.335 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:01.335 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:01.335 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.324+0000 7f977d224640 1 Processor -- start 2026-02-13T08:14:01.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.324+0000 7f977d224640 1 -- start start 2026-02-13T08:14:01.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.324+0000 7f977d224640 10 monclient: init 2026-02-13T08:14:01.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:01.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:14:01.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient(hunting): picked mon.noname-a con 0x7f9778139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:01.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient(hunting): picked mon.noname-c con 0x7f977815e200 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:01.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient(hunting): picked mon.noname-b con 0x7f977817fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:01.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f977813aa00 con 0x7f9778139f20 2026-02-13T08:14:01.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f977808ba20 con 0x7f977815e200 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9778089e30 con 0x7f977817fd00 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient(hunting): authenticate will time out at 946.920115s 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9776d76640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f9778139f20 0x7f977813a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44852/0 (socket says 10.20.193.104:44852) 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9776d76640 1 -- 10.20.193.104:0/2174519564 learned_addr learned my addr 10.20.193.104:0/2174519564 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 -- 10.20.193.104:0/2174519564 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3366871061 0 0) 0x7f976c002920 con 0x7f9778139f20 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient(hunting): my global_id is 94212 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 -- 10.20.193.104:0/2174519564 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9764003620 con 0x7f9778139f20 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 -- 10.20.193.104:0/2174519564 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 36873891 0 0) 0x7f9778089e30 con 0x7f977817fd00 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient(hunting): my global_id is 104123 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 -- 10.20.193.104:0/2174519564 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f976c002920 con 0x7f977817fd00 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 -- 10.20.193.104:0/2174519564 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2189866998 0 0) 0x7f9764003620 con 0x7f9778139f20 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 -- 10.20.193.104:0/2174519564 >> v1:10.20.193.104:6790/0 conn(0x7f977817fd00 legacy=0x7f97781a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 -- 10.20.193.104:0/2174519564 >> v1:10.20.193.119:6789/0 conn(0x7f977815e200 legacy=0x7f977817e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient: _finish_hunting 0 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 monclient: found mon.noname-a 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 -- 10.20.193.104:0/2174519564 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977808a380 con 0x7f9778139f20 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient: _finish_auth 0 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient: _check_auth_tickets 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 -- 10.20.193.104:0/2174519564 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f976c002fd0 con 0x7f9778139f20 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient: dump: 2026-02-13T08:14:01.342 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 5 monclient: authenticate success, global_id 94212 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 -- 10.20.193.104:0/2174519564 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f976c003260 con 0x7f9778139f20 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 1 -- 10.20.193.104:0/2174519564 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f976c0049a0 con 0x7f9778139f20 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:01.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775d74640 10 monclient: dump: 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 4 set_mon_vals no callback set 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: shutdown 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- 10.20.193.104:0/2174519564 >> v1:10.20.193.104:6789/0 conn(0x7f9778139f20 legacy=0x7f977813a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- 10.20.193.104:0/2174519564 shutdown_connections 2026-02-13T08:14:01.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- 10.20.193.104:0/2174519564 >> 10.20.193.104:0/2174519564 conn(0x7f9778051a50 msgr2=0x7f9778051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- 10.20.193.104:0/2174519564 shutdown_connections 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- 10.20.193.104:0/2174519564 wait complete. 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: build_initial_monmap 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: monmap: 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 librados: starting msgr at 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 librados: starting objecter 2026-02-13T08:14:01.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 Processor -- start 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- start start 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 librados: setting wanted keys 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 librados: calling monclient init 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: init 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient(hunting): picked mon.noname-c con 0x7f9778139f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient(hunting): picked mon.noname-a con 0x7f977815e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient(hunting): picked mon.noname-b con 0x7f977817fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f977805b4d0 con 0x7f977815e200 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9778152fb0 con 0x7f977817fd00 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f977805c1f0 con 0x7f9778139f20 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient(hunting): authenticate will time out at 946.922261s 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9776d76640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f9778139f20 0x7f9778152190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57594/0 (socket says 10.20.193.104:57594) 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9776d76640 1 -- 10.20.193.104:0/423373548 learned_addr learned my addr 10.20.193.104:0/423373548 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 client.?.objecter ms_handle_connect 0x7f9778139f20 2026-02-13T08:14:01.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3979235517 0 0) 0x7f977805c1f0 con 0x7f9778139f20 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): my global_id is 104126 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9744003620 con 0x7f9778139f20 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 client.?.objecter ms_handle_connect 0x7f977815e200 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1602681302 0 0) 0x7f97600038d0 con 0x7f977815e200 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): my global_id is 94215 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f977805c1f0 con 0x7f977815e200 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2992215260 0 0) 0x7f9744003620 con 0x7f9778139f20 2026-02-13T08:14:01.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97600038d0 con 0x7f9778139f20 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f976c003410 con 0x7f9778139f20 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): dump: 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:01.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 client.?.objecter ms_handle_connect 0x7f977817fd00 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3922675397 0 0) 0x7f97600038d0 con 0x7f9778139f20 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 >> v1:10.20.193.119:6789/0 conn(0x7f977817fd00 legacy=0x7f9778127ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 >> v1:10.20.193.104:6789/0 conn(0x7f977815e200 legacy=0x7f97781528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient: _finish_hunting 0 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 monclient: found mon.c 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f977805cb80 con 0x7f9778139f20 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient: _finish_auth 0 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient: _check_auth_tickets 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 5 monclient: authenticate success, global_id 104126 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: _renew_subs 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f977813c6f0 con 0x7f9778139f20 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 client.104126.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: _renew_subs 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f977805bf10 con 0x7f9778139f20 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 librados: init done 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f976c003260 con 0x7f9778139f20 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f976c0050a0 con 0x7f9778139f20 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 monclient: dump: 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.350 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9775573640 4 set_mon_vals no callback set 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f976c0110b0 con 0x7f9778139f20 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f977d224640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9778153df0 con 0x7f9778153a20 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f976c04a7d0 con 0x7f9778139f20 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 client.104126.objecter ms_dispatch2 0x7f9778000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 3 client.104126.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 3 client.104126.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 20 client.104126.objecter dump_active .. 0 homeless 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f9777577640 10 monclient: get_auth_request con 0x7f974403b890 auth_method 0 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 client.104126.objecter ms_handle_connect 0x7f9778153a20 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 client.104126.objecter resend_mon_ops 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.328+0000 7f97577fe640 10 client.104126.objecter ms_handle_connect 0x7f974403b890 2026-02-13T08:14:01.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833544807 0 0) 0x7f9778153df0 con 0x7f9778153a20 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 10 monclient(hunting): my global_id is 74698 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97600038d0 con 0x7f9778153a20 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2249487601 0 0) 0x7f97600038d0 con 0x7f9778153a20 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9778153df0 con 0x7f9778153a20 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9760002ca0 con 0x7f9778153a20 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 10 monclient: dump: 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.352 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.353 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.353 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.353 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.353 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2187616513 0 0) 0x7f9778153df0 con 0x7f9778153a20 2026-02-13T08:14:01.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.119:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f977805bc90 con 0x7f9778153a20 2026-02-13T08:14:01.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+10265 (unknown 0 0 386444097) 0x7f9760002da0 con 0x7f9778153a20 2026-02-13T08:14:01.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:01.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:01.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 >> v1:10.20.193.119:6789/0 conn(0x7f9778153a20 legacy=0x7f977813abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.332+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 >> v1:10.20.193.119:6789/0 conn(0x7f9778153a20 legacy=0x7f977813abe0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:14:01.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f97780380f0 con 0x7f977813b2f0 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 10 client.104126.objecter ms_handle_connect 0x7f977813b2f0 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 10 client.104126.objecter resend_mon_ops 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797574843 0 0) 0x7f97780380f0 con 0x7f977813b2f0 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 10 monclient(hunting): my global_id is 74701 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9778153df0 con 0x7f977813b2f0 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.1 v1:10.20.193.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3164474668 0 0) 0x7f9778153df0 con 0x7f977813b2f0 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.119:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97780380f0 con 0x7f977813b2f0 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.1 v1:10.20.193.119:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f9760003420 con 0x7f977813b2f0 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 10 monclient: dump: 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.355 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.1 v1:10.20.193.119:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2268018882 0 0) 0x7f97780380f0 con 0x7f977813b2f0 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 --> v1:10.20.193.119:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9778088e20 con 0x7f977813b2f0 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 <== mon.1 v1:10.20.193.119:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+4492 (unknown 0 0 676185178) 0x7f9760003530 con 0x7f977813b2f0 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 >> v1:10.20.193.119:6789/0 conn(0x7f977813b2f0 legacy=0x7f977812a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f97577fe640 1 -- 10.20.193.104:0/423373548 >> v1:10.20.193.119:6789/0 conn(0x7f977813b2f0 legacy=0x7f977812a1e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: "state": "peon", 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: "election_epoch": 54, 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 378364, 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: "quorum": [ 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: 0, 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: 1, 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: 2 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_age": 0, 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:14:01.357 INFO:teuthology.orchestra.run.trial104.stdout: "required_con": "2453899407728394244", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "required_mon": [ 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_con": "4544132024016699391", 2026-02-13T08:14:01.358 INFO:teuthology.orchestra.run.trial104.stdout: "quorum_mon": [ 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "outside_quorum": [], 2026-02-13T08:14:01.359 INFO:teuthology.orchestra.run.trial104.stdout: "extra_probe_peers": [], 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "sync_provider": [], 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "monmap": { 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "epoch": 1, 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "fsid": "0e1d0140-145d-4ea8-a799-1ca564383c2b", 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "modified": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "created": "2026-02-13T08:05:17.826446Z", 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release": 20, 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "min_mon_release_name": "tentacle", 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "election_strategy": 1, 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "disallowed_leaders": "", 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false, 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "tiebreaker_mon": "", 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "removed_ranks": "", 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "features": { 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "persistent": [ 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "kraken", 2026-02-13T08:14:01.360 INFO:teuthology.orchestra.run.trial104.stdout: "luminous", 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "mimic", 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap-prune", 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "nautilus", 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "octopus", 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "pacific", 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "elector-pinging", 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "quincy", 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "reef", 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "squid", 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "tentacle", 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "nvmeof_beacon_diff" 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "optional": [] 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "mons": [ 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 0, 2026-02-13T08:14:01.361 INFO:teuthology.orchestra.run.trial104.stdout: "name": "a", 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789", 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6789/0", 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6789/0", 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 1, 2026-02-13T08:14:01.362 INFO:teuthology.orchestra.run.trial104.stdout: "name": "b", 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789", 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.119:6789/0", 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.119:6789/0", 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "rank": 2, 2026-02-13T08:14:01.363 INFO:teuthology.orchestra.run.trial104.stdout: "name": "c", 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "public_addrs": { 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "addrvec": [ 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790", 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 0 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "10.20.193.104:6790/0", 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "public_addr": "10.20.193.104:6790/0", 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "priority": 0, 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "weight": 0, 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "crush_location": "{}" 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "feature_map": { 2026-02-13T08:14:01.364 INFO:teuthology.orchestra.run.trial104.stdout: "mon": [ 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: "osd": [ 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: "num": 3 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: "client": [ 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: "num": 5 2026-02-13T08:14:01.365 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.366 INFO:teuthology.orchestra.run.trial104.stdout: ], 2026-02-13T08:14:01.366 INFO:teuthology.orchestra.run.trial104.stdout: "mgr": [ 2026-02-13T08:14:01.366 INFO:teuthology.orchestra.run.trial104.stdout: { 2026-02-13T08:14:01.366 INFO:teuthology.orchestra.run.trial104.stdout: "features": "0x3f0ffffffffdffff", 2026-02-13T08:14:01.366 INFO:teuthology.orchestra.run.trial104.stdout: "release": "squid", 2026-02-13T08:14:01.366 INFO:teuthology.orchestra.run.trial104.stdout: "num": 1 2026-02-13T08:14:01.366 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-13T08:14:01.366 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-13T08:14:01.366 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-13T08:14:01.366 INFO:teuthology.orchestra.run.trial104.stdout: "stretch_mode": false 2026-02-13T08:14:01.366 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:14:01.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 10 librados: watch_flush enter 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 10 librados: watch_flush exit 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 20 client.104126.objecter shutdown clearing up homeless session... 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 10 client.104126.objecter successfully canceled tick 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 1 -- 10.20.193.104:0/423373548 >> v1:10.20.193.119:6812/276487904 conn(0x7f974403b890 legacy=0x7f974405bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 10 monclient: shutdown 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 1 -- 10.20.193.104:0/423373548 >> v1:10.20.193.104:6790/0 conn(0x7f9778139f20 legacy=0x7f9778152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f9777577640 1 -- 10.20.193.104:0/423373548 reap_dead start 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f9777577640 1 -- 10.20.193.104:0/423373548 reap_dead start 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 1 -- 10.20.193.104:0/423373548 shutdown_connections 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 1 -- 10.20.193.104:0/423373548 >> 10.20.193.104:0/423373548 conn(0x7f9778051a50 msgr2=0x7f9778156500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 1 -- 10.20.193.104:0/423373548 shutdown_connections 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 1 -- 10.20.193.104:0/423373548 wait complete. 2026-02-13T08:14:01.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.336+0000 7f977d224640 1 librados: shutdown 2026-02-13T08:14:01.369 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 3 2026-02-13T08:14:01.369 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-13T08:14:01.369 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-13T08:14:01.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 10 monclient: get_monmap_and_config 2026-02-13T08:14:01.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 10 monclient: build_initial_monmap 2026-02-13T08:14:01.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 10 monclient: monmap: 2026-02-13T08:14:01.434 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:01.434 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.434 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:01.430920+0000 2026-02-13T08:14:01.434 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:01.430920+0000 2026-02-13T08:14:01.434 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:01.434 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.434 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:01.435 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:01.435 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:01.435 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 1 Processor -- start 2026-02-13T08:14:01.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 1 -- start start 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 10 monclient: init 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 10 monclient(hunting): picked mon.noname-c con 0x7f3a8808e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 10 monclient(hunting): picked mon.noname-b con 0x7f3a8808ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 10 monclient(hunting): picked mon.noname-a con 0x7f3a8817fe50 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a88089fa0 con 0x7f3a8817fe50 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a88089760 con 0x7f3a8808e4b0 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8808af90 con 0x7f3a8808ef90 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a8f00f640 10 monclient(hunting): authenticate will time out at 947.019817s 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a7ffff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f3a8808ef90 0x7f3a8817e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57606/0 (socket says 10.20.193.104:57606) 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.424+0000 7f3a7ffff640 1 -- 10.20.193.104:0/1198163988 learned_addr learned my addr 10.20.193.104:0/1198163988 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 -- 10.20.193.104:0/1198163988 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1421376273 0 0) 0x7f3a8808af90 con 0x7f3a8808ef90 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient(hunting): my global_id is 104129 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 -- 10.20.193.104:0/1198163988 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a74003620 con 0x7f3a8808ef90 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 -- 10.20.193.104:0/1198163988 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806848414 0 0) 0x7f3a88089fa0 con 0x7f3a8817fe50 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient(hunting): my global_id is 94218 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 -- 10.20.193.104:0/1198163988 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a8808af90 con 0x7f3a8817fe50 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 -- 10.20.193.104:0/1198163988 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2846620916 0 0) 0x7f3a74003620 con 0x7f3a8808ef90 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 -- 10.20.193.104:0/1198163988 >> v1:10.20.193.119:6789/0 conn(0x7f3a8808e4b0 legacy=0x7f3a8808e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 -- 10.20.193.104:0/1198163988 >> v1:10.20.193.104:6789/0 conn(0x7f3a8817fe50 legacy=0x7f3a881a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 monclient: found mon.noname-b 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 -- 10.20.193.104:0/1198163988 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8808b270 con 0x7f3a8808ef90 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient: _finish_auth 0 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 -- 10.20.193.104:0/1198163988 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3a70002e00 con 0x7f3a8808ef90 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient: dump: 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 5 monclient: authenticate success, global_id 104129 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 -- 10.20.193.104:0/1198163988 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a70003040 con 0x7f3a8808ef90 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 1 -- 10.20.193.104:0/1198163988 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3a70003480 con 0x7f3a8808ef90 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7f7fe640 10 monclient: dump: 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 4 set_mon_vals no callback set 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: shutdown 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- 10.20.193.104:0/1198163988 >> v1:10.20.193.104:6790/0 conn(0x7f3a8808ef90 legacy=0x7f3a8817e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- 10.20.193.104:0/1198163988 shutdown_connections 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- 10.20.193.104:0/1198163988 >> 10.20.193.104:0/1198163988 conn(0x7f3a88051e80 msgr2=0x7f3a8808c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- 10.20.193.104:0/1198163988 shutdown_connections 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- 10.20.193.104:0/1198163988 wait complete. 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: build_initial_monmap 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: monmap: 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:01.445 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 librados: starting msgr at 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 librados: starting objecter 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 Processor -- start 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- start start 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 librados: setting wanted keys 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 librados: calling monclient init 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: init 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient(hunting): picked mon.noname-a con 0x7f3a8808e4b0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient(hunting): picked mon.noname-b con 0x7f3a8808ef90 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient(hunting): picked mon.noname-c con 0x7f3a8817fe50 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a88080730 con 0x7f3a8808e4b0 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a88080a10 con 0x7f3a8808ef90 2026-02-13T08:14:01.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8805ca60 con 0x7f3a8817fe50 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient(hunting): authenticate will time out at 947.022221s 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8cd84640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f3a8808e4b0 0x7f3a88086aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44874/0 (socket says 10.20.193.104:44874) 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8cd84640 1 -- 10.20.193.104:0/3520096591 learned_addr learned my addr 10.20.193.104:0/3520096591 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 client.?.objecter ms_handle_connect 0x7f3a8817fe50 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 client.?.objecter ms_handle_connect 0x7f3a8808e4b0 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37230112 0 0) 0x7f3a8805ca60 con 0x7f3a8817fe50 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): my global_id is 104132 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a58003620 con 0x7f3a8817fe50 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782740295 0 0) 0x7f3a88080730 con 0x7f3a8808e4b0 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): my global_id is 94221 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a8805ca60 con 0x7f3a8808e4b0 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 client.?.objecter ms_handle_connect 0x7f3a8808ef90 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3342740506 0 0) 0x7f3a58003620 con 0x7f3a8817fe50 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a88080730 con 0x7f3a8817fe50 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3a84003550 con 0x7f3a8817fe50 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): dump: 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.448 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2304402392 0 0) 0x7f3a8805ca60 con 0x7f3a8808e4b0 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a58003620 con 0x7f3a8808e4b0 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3a780031a0 con 0x7f3a8808e4b0 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): dump: 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.449 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3933230093 0 0) 0x7f3a88080a10 con 0x7f3a8808ef90 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient(hunting): my global_id is 74704 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a8805ca60 con 0x7f3a8808ef90 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2061643935 0 0) 0x7f3a88080730 con 0x7f3a8817fe50 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 >> v1:10.20.193.119:6789/0 conn(0x7f3a8808ef90 legacy=0x7f3a880871b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 >> v1:10.20.193.104:6789/0 conn(0x7f3a8808e4b0 legacy=0x7f3a88086aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient: _finish_hunting 0 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 monclient: found mon.c 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:01.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a88059ee0 con 0x7f3a8817fe50 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient: _finish_auth 0 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient: _check_auth_tickets 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 5 monclient: authenticate success, global_id 104132 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: _renew_subs 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- 10.20.193.104:0/3520096591 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3a88086790 con 0x7f3a8817fe50 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 client.104132.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: _renew_subs 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- 10.20.193.104:0/3520096591 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3a8807f5c0 con 0x7f3a8817fe50 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 librados: init done 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a840039a0 con 0x7f3a8817fe50 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3a84003db0 con 0x7f3a8817fe50 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:01.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 monclient: dump: 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7effd640 4 set_mon_vals no callback set 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f3a8400fdc0 con 0x7f3a8817fe50 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8f00f640 1 -- 10.20.193.104:0/3520096591 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a88061860 con 0x7f3a8817fe50 2026-02-13T08:14:01.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f3a840495d0 con 0x7f3a8817fe50 2026-02-13T08:14:01.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 client.104132.objecter ms_dispatch2 0x7f3a88000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:01.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 3 client.104132.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:01.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 3 client.104132.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:01.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 20 client.104132.objecter dump_active .. 0 homeless 2026-02-13T08:14:01.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a8cd84640 10 monclient: get_auth_request con 0x7f3a5803ba50 auth_method 0 2026-02-13T08:14:01.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.428+0000 7f3a7d7fa640 10 client.104132.objecter ms_handle_connect 0x7f3a5803ba50 2026-02-13T08:14:01.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.432+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f3a84015c90 con 0x7f3a8817fe50 2026-02-13T08:14:01.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.432+0000 7f3a7d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:01.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.432+0000 7f3a7d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:01.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-13T08:14:01.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-13T08:14:01.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:01.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 1 -- 10.20.193.104:0/3520096591 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f3a8808cc70 con 0x7f3a8817fe50 2026-02-13T08:14:01.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a7d7fa640 1 -- 10.20.193.104:0/3520096591 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f3a84015590 con 0x7f3a8817fe50 2026-02-13T08:14:01.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a7d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-13T08:14:01.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a7d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:14:01.558 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.558 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=10,logm=59} crc {auth=4241704348,config=3140514010,health=2969413476,kv=1692168360,logm=3498084702}) 2026-02-13T08:14:01.558 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=12,kv=9,logm=60} crc {auth=2343276712,config=3140514009,health=1755065028,kv=4002461713,logm=2796954404}) 2026-02-13T08:14:01.558 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.558 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=17,config=2,health=12,kv=10,logm=59} crc {auth=4241704348,config=3140514010,health=2969413476,kv=1692168360,logm=3498084702}) 2026-02-13T08:14:01.558 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=18,config=2,health=11,kv=9,logm=60} crc {auth=698057733,config=3140514009,health=1967553788,kv=2370371023,logm=1662744710}) 2026-02-13T08:14:01.559 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 10 librados: watch_flush enter 2026-02-13T08:14:01.559 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 10 librados: watch_flush exit 2026-02-13T08:14:01.559 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 20 client.104132.objecter shutdown clearing up homeless session... 2026-02-13T08:14:01.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 10 client.104132.objecter successfully canceled tick 2026-02-13T08:14:01.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 1 -- 10.20.193.104:0/3520096591 >> v1:10.20.193.119:6812/276487904 conn(0x7f3a5803ba50 legacy=0x7f3a5805bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 10 monclient: shutdown 2026-02-13T08:14:01.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:01.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 1 -- 10.20.193.104:0/3520096591 >> v1:10.20.193.104:6790/0 conn(0x7f3a8817fe50 legacy=0x7f3a880878c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:01.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 1 -- 10.20.193.104:0/3520096591 shutdown_connections 2026-02-13T08:14:01.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 1 -- 10.20.193.104:0/3520096591 >> 10.20.193.104:0/3520096591 conn(0x7f3a88051e80 msgr2=0x7f3a8805cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:01.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 1 -- 10.20.193.104:0/3520096591 shutdown_connections 2026-02-13T08:14:01.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 1 -- 10.20.193.104:0/3520096591 wait complete. 2026-02-13T08:14:01.561 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.561 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1862571107}) 2026-02-13T08:14:01.561 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1505323118}) 2026-02-13T08:14:01.561 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:01.548+0000 7f3a8f00f640 1 librados: shutdown 2026-02-13T08:14:01.567 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1862571107}) 2026-02-13T08:14:01.567 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2384439800}) 2026-02-13T08:14:01.567 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.567 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1729123105}) 2026-02-13T08:14:01.567 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2943240707}) 2026-02-13T08:14:01.567 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.567 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1729123105}) 2026-02-13T08:14:01.567 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.548+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=308300970}) 2026-02-13T08:14:01.567 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1476985831}) 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1667803948}) 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1476985831}) 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=156480500}) 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477084544}) 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3062243264}) 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3477084544}) 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=448283211}) 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.568 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057921515}) 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3554801260}) 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4057921515}) 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1140803037}) 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2083690367}) 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2727703527}) 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2083690367}) 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1054638284}) 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.569 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1760311890}) 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3737552615}) 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1760311890}) 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3594924355}) 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2818515964}) 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3698341067}) 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2818515964}) 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1242175596}) 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3526688894}) 2026-02-13T08:14:01.570 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1494275892}) 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3526688894}) 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.552+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1112163975}) 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3084690455}) 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2057962034}) 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3084690455}) 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3130488986}) 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1077058991}) 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3233723460}) 2026-02-13T08:14:01.571 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1077058991}) 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3345703672}) 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492462071}) 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2282302680}) 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1492462071}) 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3039910003}) 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4186647951}) 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=372744117}) 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.572 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4186647951}) 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3014044048}) 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2389532277}) 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2157559471}) 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2389532277}) 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1254647137}) 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4143869876}) 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3346898940}) 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.573 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4143869876}) 2026-02-13T08:14:01.574 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3531316322}) 2026-02-13T08:14:01.574 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.574 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=822404764}) 2026-02-13T08:14:01.574 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1969992236}) 2026-02-13T08:14:01.574 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.574 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=822404764}) 2026-02-13T08:14:01.574 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2644518961}) 2026-02-13T08:14:01.575 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-13T08:14:01.583 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.583 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796182777}) 2026-02-13T08:14:01.583 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.556+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3662000108}) 2026-02-13T08:14:01.584 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.584 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=796182777}) 2026-02-13T08:14:01.584 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1657478553}) 2026-02-13T08:14:01.584 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.584 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247662798}) 2026-02-13T08:14:01.584 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2262111983}) 2026-02-13T08:14:01.584 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.584 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247662798}) 2026-02-13T08:14:01.584 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=578466755}) 2026-02-13T08:14:01.584 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.584 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2131635177}) 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1307704446}) 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2131635177}) 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3736735338}) 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343639917}) 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2990565253}) 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343639917}) 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=219026122}) 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394342953}) 2026-02-13T08:14:01.585 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=327149278}) 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394342953}) 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2163183265}) 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3300276561}) 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3310711891}) 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3300276561}) 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1937175759}) 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4023338075}) 2026-02-13T08:14:01.586 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1856047466}) 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4023338075}) 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2590657095}) 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2783386609}) 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=353671432}) 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2783386609}) 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.560+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=589796412}) 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864730081}) 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=217783646}) 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.587 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864730081}) 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3102593027}) 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156101813}) 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4060406909}) 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156101813}) 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1846226602}) 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=961489160}) 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=363222262}) 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=961489160}) 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2539128110}) 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.588 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3959493229}) 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1482553756}) 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3959493229}) 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1004919461}) 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4203861088}) 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=907356442}) 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4203861088}) 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=58240399}) 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4037946474}) 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3007700544}) 2026-02-13T08:14:01.589 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4037946474}) 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=156864008}) 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1653819987}) 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1741504357}) 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1653819987}) 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4242472704}) 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461379722}) 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=429004985}) 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461379722}) 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.564+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1316737687}) 2026-02-13T08:14:01.590 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1156071726}) 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2024739723}) 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1156071726}) 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=698996060}) 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=1} crc {logm=3561014365,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=2536983079,mon_config_key=1358190956,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=2315316943,osd_pg_creating=3621575123,osd_snap=2628044122,osdmap=2163373635}) 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=43,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=13} crc {logm=2859668207,mdsmap=2858549010,mgr=2854152735,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=3388653472,mon_config_key=2920495307,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=2315316943,osd_pg_creating=3621575123,osd_snap=2551307181}) 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=40,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=7,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=16,osdmap=1} crc {logm=3561014365,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=2536983079,mon_config_key=1358190956,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=2315316943,osd_pg_creating=3621575123,osd_snap=2628044122,osdmap=2163373635}) 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=41,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=6,monmap=3,nvmeofgw=3,osd_metadata=6,osd_snap=17} crc {logm=3853936432,mdsmap=2858549010,mgr=3181626538,mgr_command_descs=1283023072,mgr_metadata=3362623422,mgrstat=3388653472,mon_config_key=4182565050,monmap=3655561526,nvmeofgw=3360707892,osd_metadata=2315316943,osd_snap=1478898059}) 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2070471274}) 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=1547888730}) 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.591 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2070471274}) 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3506433675}) 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=593838027}) 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4207116213}) 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=593838027}) 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=230116152}) 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2079689453}) 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2441131}) 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2079689453}) 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.568+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1373307906}) 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.592 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1788851294}) 2026-02-13T08:14:01.593 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2114560320}) 2026-02-13T08:14:01.593 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.593 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1788851294}) 2026-02-13T08:14:01.593 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1903573848}) 2026-02-13T08:14:01.593 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.593 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=77} crc {osdmap=28474759}) 2026-02-13T08:14:01.593 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=80} crc {osdmap=586742111}) 2026-02-13T08:14:01.593 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-13T08:14:01.593 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=77} crc {osdmap=28474759}) 2026-02-13T08:14:01.593 INFO:tasks.ceph.mon.a.trial104.stderr:2026-02-13T08:14:01.572+0000 7fc4fbfe9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=81} crc {osdmap=694867135}) 2026-02-13T08:14:02.576 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 3 2026-02-13T08:14:02.577 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-13T08:14:02.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 10 monclient: get_monmap_and_config 2026-02-13T08:14:02.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 10 monclient: build_initial_monmap 2026-02-13T08:14:02.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 10 monclient: monmap: 2026-02-13T08:14:02.638 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:02.638 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.638 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:02.634517+0000 2026-02-13T08:14:02.638 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:02.634517+0000 2026-02-13T08:14:02.638 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:02.638 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.638 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:02.639 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:02.639 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:02.639 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.646 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 1 Processor -- start 2026-02-13T08:14:02.646 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 1 -- start start 2026-02-13T08:14:02.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 10 monclient: init 2026-02-13T08:14:02.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:02.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:14:02.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 10 monclient(hunting): picked mon.noname-b con 0x7f622408e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:02.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 10 monclient(hunting): picked mon.noname-a con 0x7f622408ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:02.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 10 monclient(hunting): picked mon.noname-c con 0x7f622417fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:02.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6224089fa0 con 0x7f622408ef90 2026-02-13T08:14:02.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6224089760 con 0x7f622417fe50 2026-02-13T08:14:02.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f622408af90 con 0x7f622408e4b0 2026-02-13T08:14:02.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:02.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f622b190640 10 monclient(hunting): authenticate will time out at 948.223583s 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f6228f05640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f622408e4b0 0x7f622408e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57626/0 (socket says 10.20.193.104:57626) 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f6228f05640 1 -- 10.20.193.104:0/2969069721 learned_addr learned my addr 10.20.193.104:0/2969069721 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 1 -- 10.20.193.104:0/2969069721 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2471668196 0 0) 0x7f622408af90 con 0x7f622408e4b0 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 10 monclient(hunting): my global_id is 104135 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 1 -- 10.20.193.104:0/2969069721 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6210003620 con 0x7f622408e4b0 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 1 -- 10.20.193.104:0/2969069721 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047600941 0 0) 0x7f6224089fa0 con 0x7f622408ef90 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:02.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 10 monclient(hunting): my global_id is 94224 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.628+0000 7f621b7fe640 1 -- 10.20.193.104:0/2969069721 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f622408af90 con 0x7f622408ef90 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 1 -- 10.20.193.104:0/2969069721 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1890824783 0 0) 0x7f622408af90 con 0x7f622408ef90 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 1 -- 10.20.193.104:0/2969069721 >> v1:10.20.193.104:6790/0 conn(0x7f622408e4b0 legacy=0x7f622408e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 1 -- 10.20.193.104:0/2969069721 >> v1:10.20.193.119:6789/0 conn(0x7f622417fe50 legacy=0x7f62241a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 1 monclient: found mon.noname-a 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 1 -- 10.20.193.104:0/2969069721 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622408b270 con 0x7f622408ef90 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 10 monclient: _finish_auth 0 2026-02-13T08:14:02.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 1 -- 10.20.193.104:0/2969069721 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f620c002e00 con 0x7f622408ef90 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 10 monclient: dump: 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.650 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 5 monclient: authenticate success, global_id 94224 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 1 -- 10.20.193.104:0/2969069721 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f620c003100 con 0x7f622408ef90 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 1 -- 10.20.193.104:0/2969069721 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f620c003540 con 0x7f622408ef90 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621b7fe640 10 monclient: dump: 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:02.651 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.652 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.652 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.652 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:02.652 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.652 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:02.652 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:02.652 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:02.652 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.652 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:02.652 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 4 set_mon_vals no callback set 2026-02-13T08:14:02.652 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: shutdown 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- 10.20.193.104:0/2969069721 >> v1:10.20.193.104:6789/0 conn(0x7f622408ef90 legacy=0x7f622417e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- 10.20.193.104:0/2969069721 shutdown_connections 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- 10.20.193.104:0/2969069721 >> 10.20.193.104:0/2969069721 conn(0x7f6224051e80 msgr2=0x7f622408c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- 10.20.193.104:0/2969069721 shutdown_connections 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- 10.20.193.104:0/2969069721 wait complete. 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: build_initial_monmap 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: monmap: 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:02.653 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 librados: starting msgr at 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 librados: starting objecter 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 Processor -- start 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- start start 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 librados: setting wanted keys 2026-02-13T08:14:02.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 librados: calling monclient init 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: init 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient(hunting): picked mon.noname-a con 0x7f622408e4b0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient(hunting): picked mon.noname-c con 0x7f622408ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient(hunting): picked mon.noname-b con 0x7f622417fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6224085600 con 0x7f622408e4b0 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6224087f40 con 0x7f622417fe50 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f6228f05640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f622408e4b0 0x7f6224084ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44906/0 (socket says 10.20.193.104:44906) 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f6228f05640 1 -- 10.20.193.104:0/736561809 learned_addr learned my addr 10.20.193.104:0/736561809 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- 10.20.193.104:0/736561809 --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6224080990 con 0x7f622408ef90 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:02.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient(hunting): authenticate will time out at 948.226059s 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 client.?.objecter ms_handle_connect 0x7f622408e4b0 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 client.?.objecter ms_handle_connect 0x7f622408ef90 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 753143046 0 0) 0x7f6224085600 con 0x7f622408e4b0 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): my global_id is 94227 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61f4003620 con 0x7f622408e4b0 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3906081107 0 0) 0x7f6224080990 con 0x7f622408ef90 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:02.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): my global_id is 104138 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6224085600 con 0x7f622408ef90 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2948591602 0 0) 0x7f6224085600 con 0x7f622408ef90 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6224080990 con 0x7f622408ef90 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f620c003450 con 0x7f622408ef90 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): dump: 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.657 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1986203273 0 0) 0x7f61f4003620 con 0x7f622408e4b0 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6224085600 con 0x7f622408e4b0 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f6214002f70 con 0x7f622408e4b0 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:02.658 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient(hunting): dump: 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2963218453 0 0) 0x7f6224080990 con 0x7f622408ef90 2026-02-13T08:14:02.659 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 >> v1:10.20.193.119:6789/0 conn(0x7f622417fe50 legacy=0x7f6224170950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 >> v1:10.20.193.104:6789/0 conn(0x7f622408e4b0 legacy=0x7f6224084ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient: _finish_hunting 0 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 monclient: found mon.c 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6224059e30 con 0x7f622408ef90 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient: _finish_auth 0 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient: _check_auth_tickets 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 5 monclient: authenticate success, global_id 104138 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: _renew_subs 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:02.660 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- 10.20.193.104:0/736561809 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6224088540 con 0x7f622408ef90 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 client.104138.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: _renew_subs 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- 10.20.193.104:0/736561809 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f622407f540 con 0x7f622408ef90 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 librados: init done 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f620c003b10 con 0x7f622408ef90 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f620c003e60 con 0x7f622408ef90 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 monclient: dump: 2026-02-13T08:14:02.661 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f621affd640 4 set_mon_vals no callback set 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:02.662 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f622b190640 1 -- 10.20.193.104:0/736561809 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f622407f300 con 0x7f622408ef90 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f620c00fe70 con 0x7f622408ef90 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f620c049360 con 0x7f622408ef90 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 10 client.104138.objecter ms_dispatch2 0x7f6224000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 3 client.104138.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 3 client.104138.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f62197fa640 20 client.104138.objecter dump_active .. 0 homeless 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.632+0000 7f6228f05640 10 monclient: get_auth_request con 0x7f61f403b870 auth_method 0 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.636+0000 7f62197fa640 10 client.104138.objecter ms_handle_connect 0x7f61f403b870 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.636+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f620c015b40 con 0x7f622408ef90 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.636+0000 7f62197fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:02.663 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.636+0000 7f62197fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:02.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-13T08:14:02.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-13T08:14:02.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:02.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 1 -- 10.20.193.104:0/736561809 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f62240380f0 con 0x7f622408ef90 2026-02-13T08:14:02.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f62197fa640 1 -- 10.20.193.104:0/736561809 <== mon.2 v1:10.20.193.104:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+1475 (unknown 254746657 0 1656552108) 0x7f620c015440 con 0x7f622408ef90 2026-02-13T08:14:02.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f62197fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-13T08:14:02.761 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f62197fa640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:14:02.761 INFO:teuthology.orchestra.run.trial104.stdout:{"election_epoch":54,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","modified":"2026-02-13T08:05:17.826446Z","created":"2026-02-13T08:05:17.826446Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6789","nonce":0}]},"addr":"10.20.193.119:6789/0","public_addr":"10.20.193.119:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6790","nonce":0}]},"addr":"10.20.193.104:6790/0","public_addr":"10.20.193.104:6790/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2026-02-13T08:14:02.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 10 librados: watch_flush enter 2026-02-13T08:14:02.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 10 librados: watch_flush exit 2026-02-13T08:14:02.762 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 20 client.104138.objecter shutdown clearing up homeless session... 2026-02-13T08:14:02.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 10 client.104138.objecter successfully canceled tick 2026-02-13T08:14:02.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 1 -- 10.20.193.104:0/736561809 >> v1:10.20.193.119:6812/276487904 conn(0x7f61f403b870 legacy=0x7f61f405bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 10 monclient: shutdown 2026-02-13T08:14:02.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:02.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 1 -- 10.20.193.104:0/736561809 >> v1:10.20.193.104:6790/0 conn(0x7f622408ef90 legacy=0x7f622416f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 1 -- 10.20.193.104:0/736561809 shutdown_connections 2026-02-13T08:14:02.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 1 -- 10.20.193.104:0/736561809 >> 10.20.193.104:0/736561809 conn(0x7f6224051e80 msgr2=0x7f622405c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:02.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 1 -- 10.20.193.104:0/736561809 shutdown_connections 2026-02-13T08:14:02.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 1 -- 10.20.193.104:0/736561809 wait complete. 2026-02-13T08:14:02.763 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.752+0000 7f622b190640 1 librados: shutdown 2026-02-13T08:14:02.770 INFO:tasks.mon_thrash.ceph_manager:quorum is size 3 2026-02-13T08:14:02.770 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-13T08:14:02.780 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-13T08:14:02.781 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T08:14:02.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.840+0000 7f0f4f754640 10 monclient: get_monmap_and_config 2026-02-13T08:14:02.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.840+0000 7f0f4f754640 10 monclient: build_initial_monmap 2026-02-13T08:14:02.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.840+0000 7f0f4f754640 10 monclient: monmap: 2026-02-13T08:14:02.851 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:02.851 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.851 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:02.847606+0000 2026-02-13T08:14:02.851 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:02.847606+0000 2026-02-13T08:14:02.851 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:02.851 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.852 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:02.852 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:02.852 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:02.852 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.859 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.840+0000 7f0f4f754640 1 Processor -- start 2026-02-13T08:14:02.859 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- start start 2026-02-13T08:14:02.860 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: init 2026-02-13T08:14:02.860 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:02.860 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:14:02.860 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient(hunting): picked mon.noname-b con 0x7f0f4813c0c0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:02.860 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient(hunting): picked mon.noname-c con 0x7f0f4813cba0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:02.860 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient(hunting): picked mon.noname-a con 0x7f0f48181f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:02.860 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4808ee60 con 0x7f0f48181f20 2026-02-13T08:14:02.860 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f480870f0 con 0x7f0f4813cba0 2026-02-13T08:14:02.860 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f48087330 con 0x7f0f4813c0c0 2026-02-13T08:14:02.860 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:02.860 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient(hunting): authenticate will time out at 948.436587s 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4d4c9640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f0f4813c0c0 0x7f0f4813c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57654/0 (socket says 10.20.193.104:57654) 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4d4c9640 1 -- 10.20.193.104:0/1561393457 learned_addr learned my addr 10.20.193.104:0/1561393457 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 -- 10.20.193.104:0/1561393457 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931821867 0 0) 0x7f0f4808ee60 con 0x7f0f48181f20 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient(hunting): my global_id is 94230 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 -- 10.20.193.104:0/1561393457 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f30003620 con 0x7f0f48181f20 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 -- 10.20.193.104:0/1561393457 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 385142909 0 0) 0x7f0f48087330 con 0x7f0f4813c0c0 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:02.861 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient(hunting): my global_id is 104141 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 -- 10.20.193.104:0/1561393457 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f4808ee60 con 0x7f0f4813c0c0 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 -- 10.20.193.104:0/1561393457 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 429009370 0 0) 0x7f0f4808ee60 con 0x7f0f4813c0c0 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 -- 10.20.193.104:0/1561393457 >> v1:10.20.193.119:6789/0 conn(0x7f0f4813cba0 legacy=0x7f0f48180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 -- 10.20.193.104:0/1561393457 >> v1:10.20.193.104:6789/0 conn(0x7f0f48181f20 legacy=0x7f0f481a2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient: _finish_hunting 0 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 monclient: found mon.noname-b 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 -- 10.20.193.104:0/1561393457 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f48140150 con 0x7f0f4813c0c0 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient: _finish_auth 0 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient: _check_auth_tickets 2026-02-13T08:14:02.862 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:02.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 -- 10.20.193.104:0/1561393457 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0f38002e00 con 0x7f0f4813c0c0 2026-02-13T08:14:02.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:02.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:02.863 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient: dump: 2026-02-13T08:14:02.863 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:02.863 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.863 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.863 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.863 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:02.863 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.863 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 5 monclient: authenticate success, global_id 104141 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 -- 10.20.193.104:0/1561393457 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f380030c0 con 0x7f0f4813c0c0 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 1 -- 10.20.193.104:0/1561393457 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0f38003500 con 0x7f0f4813c0c0 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f37fff640 10 monclient: dump: 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:02.864 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 4 set_mon_vals no callback set 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: shutdown 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:02.865 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- 10.20.193.104:0/1561393457 >> v1:10.20.193.104:6790/0 conn(0x7f0f4813c0c0 legacy=0x7f0f4813c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- 10.20.193.104:0/1561393457 shutdown_connections 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- 10.20.193.104:0/1561393457 >> 10.20.193.104:0/1561393457 conn(0x7f0f48090810 msgr2=0x7f0f48090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- 10.20.193.104:0/1561393457 shutdown_connections 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- 10.20.193.104:0/1561393457 wait complete. 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: build_initial_monmap 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: monmap: 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:02.866 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 librados: starting msgr at 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 librados: starting objecter 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 Processor -- start 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- start start 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 librados: setting wanted keys 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 librados: calling monclient init 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: init 2026-02-13T08:14:02.867 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient(hunting): picked mon.noname-a con 0x7f0f4813c0c0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient(hunting): picked mon.noname-b con 0x7f0f4813cba0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient(hunting): picked mon.noname-c con 0x7f0f48181f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4810aa90 con 0x7f0f4813c0c0 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4810ad70 con 0x7f0f4813cba0 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f4808ab30 con 0x7f0f48181f20 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient(hunting): authenticate will time out at 948.438945s 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4d4c9640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f0f4813c0c0 0x7f0f4813b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44918/0 (socket says 10.20.193.104:44918) 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4d4c9640 1 -- 10.20.193.104:0/3518632885 learned_addr learned my addr 10.20.193.104:0/3518632885 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 client.?.objecter ms_handle_connect 0x7f0f48181f20 2026-02-13T08:14:02.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 client.?.objecter ms_handle_connect 0x7f0f4813c0c0 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101095410 0 0) 0x7f0f4810aa90 con 0x7f0f4813c0c0 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): my global_id is 94233 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f18003620 con 0x7f0f4813c0c0 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491079285 0 0) 0x7f0f4808ab30 con 0x7f0f48181f20 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:02.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): my global_id is 104144 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f4810aa90 con 0x7f0f48181f20 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 client.?.objecter ms_handle_connect 0x7f0f4813cba0 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1188990593 0 0) 0x7f0f4810aa90 con 0x7f0f48181f20 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f4808ab30 con 0x7f0f48181f20 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0f440032e0 con 0x7f0f48181f20 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): dump: 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.870 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2474095206 0 0) 0x7f0f18003620 con 0x7f0f4813c0c0 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f4810aa90 con 0x7f0f4813c0c0 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0f38002dc0 con 0x7f0f4813c0c0 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:02.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): dump: 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1293952952 0 0) 0x7f0f4810ad70 con 0x7f0f4813cba0 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient(hunting): my global_id is 74710 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f18003620 con 0x7f0f4813cba0 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3767796869 0 0) 0x7f0f4808ab30 con 0x7f0f48181f20 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 >> v1:10.20.193.119:6789/0 conn(0x7f0f4813cba0 legacy=0x7f0f48180800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 >> v1:10.20.193.104:6789/0 conn(0x7f0f4813c0c0 legacy=0x7f0f4813b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 monclient: found mon.c 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:02.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f48093570 con 0x7f0f48181f20 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient: _finish_auth 0 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 5 monclient: authenticate success, global_id 104144 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: _renew_subs 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- 10.20.193.104:0/3518632885 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4808d220 con 0x7f0f48181f20 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 client.104144.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: _renew_subs 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 -- 10.20.193.104:0/3518632885 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f481295b0 con 0x7f0f48181f20 2026-02-13T08:14:02.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 1 librados: init done 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f44003890 con 0x7f0f48181f20 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f0f44003ca0 con 0x7f0f48181f20 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f35ffb640 10 monclient: dump: 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:02.875 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f377fe640 4 set_mon_vals no callback set 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.844+0000 7f0f4f754640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.848+0000 7f0f4f754640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.848+0000 7f0f4f754640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.848+0000 7f0f4f754640 1 -- 10.20.193.104:0/3518632885 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f4810a280 con 0x7f0f48181f20 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.848+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f0f44003e40 con 0x7f0f48181f20 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.848+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f0f44049650 con 0x7f0f48181f20 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.848+0000 7f0f35ffb640 10 client.104144.objecter ms_dispatch2 0x7f0f48000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:02.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.848+0000 7f0f35ffb640 3 client.104144.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:02.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.848+0000 7f0f35ffb640 3 client.104144.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:02.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.848+0000 7f0f35ffb640 20 client.104144.objecter dump_active .. 0 homeless 2026-02-13T08:14:02.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.848+0000 7f0f4d4c9640 10 monclient: get_auth_request con 0x7f0f1803bbe0 auth_method 0 2026-02-13T08:14:02.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.848+0000 7f0f35ffb640 10 client.104144.objecter ms_handle_connect 0x7f0f1803bbe0 2026-02-13T08:14:02.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.852+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f0f44015dd0 con 0x7f0f48181f20 2026-02-13T08:14:02.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.852+0000 7f0f35ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:02.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.852+0000 7f0f35ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:02.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.928+0000 7f0f4f754640 1 -- 10.20.193.104:0/3518632885 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0f48109fb0 con 0x7f0f1803bbe0 2026-02-13T08:14:02.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f35ffb640 1 -- 10.20.193.104:0/3518632885 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+114241 (unknown 2965378022 0 1200255480) 0x7f0f48109fb0 con 0x7f0f1803bbe0 2026-02-13T08:14:02.942 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:14:02.943 INFO:teuthology.orchestra.run.trial104.stderr:dumped all 2026-02-13T08:14:02.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 10 librados: watch_flush enter 2026-02-13T08:14:02.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 10 librados: watch_flush exit 2026-02-13T08:14:02.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 20 client.104144.objecter shutdown clearing up homeless session... 2026-02-13T08:14:02.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 10 client.104144.objecter successfully canceled tick 2026-02-13T08:14:02.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 1 -- 10.20.193.104:0/3518632885 >> v1:10.20.193.119:6812/276487904 conn(0x7f0f1803bbe0 legacy=0x7f0f1805c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 10 monclient: shutdown 2026-02-13T08:14:02.944 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:02.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 1 -- 10.20.193.104:0/3518632885 >> v1:10.20.193.104:6790/0 conn(0x7f0f48181f20 legacy=0x7f0f48112300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:02.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 1 -- 10.20.193.104:0/3518632885 shutdown_connections 2026-02-13T08:14:02.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 1 -- 10.20.193.104:0/3518632885 >> 10.20.193.104:0/3518632885 conn(0x7f0f48090810 msgr2=0x7f0f48057f00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:02.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 1 -- 10.20.193.104:0/3518632885 shutdown_connections 2026-02-13T08:14:02.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 1 -- 10.20.193.104:0/3518632885 wait complete. 2026-02-13T08:14:02.945 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:02.932+0000 7f0f4f754640 1 librados: shutdown 2026-02-13T08:14:02.951 INFO:teuthology.orchestra.run.trial104.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2026-02-13T08:14:01.932604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":158,"num_write_kb":2685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":400360,"kb_used_data":22024,"kb_used_omap":21102,"kb_used_meta":357137,"kb_avail":565830680,"statfs":{"total":579820584960,"available":579410616320,"internally_reserved":0,"allocated":22552576,"data_stored":15637316,"data_compressed":3933748,"data_compressed_allocated":7913472,"data_compressed_original":12727568,"omap_allocated":21609368,"internal_metadata":365708392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001162"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878544+0000","last_change":"2026-02-13T08:06:16.712986+0000","last_active":"2026-02-13T08:12:35.878544+0000","last_peered":"2026-02-13T08:12:35.878544+0000","last_clean":"2026-02-13T08:12:35.878544+0000","last_became_active":"2026-02-13T08:06:16.696600+0000","last_became_peered":"2026-02-13T08:06:16.696600+0000","last_unstale":"2026-02-13T08:12:35.878544+0000","last_undegraded":"2026-02-13T08:12:35.878544+0000","last_fullsized":"2026-02-13T08:12:35.878544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:46.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885618+0000","last_change":"2026-02-13T08:06:16.753790+0000","last_active":"2026-02-13T08:12:35.885618+0000","last_peered":"2026-02-13T08:12:35.885618+0000","last_clean":"2026-02-13T08:12:35.885618+0000","last_became_active":"2026-02-13T08:06:16.748269+0000","last_became_peered":"2026-02-13T08:06:16.748269+0000","last_unstale":"2026-02-13T08:12:35.885618+0000","last_undegraded":"2026-02-13T08:12:35.885618+0000","last_fullsized":"2026-02-13T08:12:35.885618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:07.517559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885651+0000","last_change":"2026-02-13T08:06:16.803804+0000","last_active":"2026-02-13T08:12:35.885651+0000","last_peered":"2026-02-13T08:12:35.885651+0000","last_clean":"2026-02-13T08:12:35.885651+0000","last_became_active":"2026-02-13T08:06:16.802337+0000","last_became_peered":"2026-02-13T08:06:16.802337+0000","last_unstale":"2026-02-13T08:12:35.885651+0000","last_undegraded":"2026-02-13T08:12:35.885651+0000","last_fullsized":"2026-02-13T08:12:35.885651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:11.597242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878322+0000","last_change":"2026-02-13T08:06:16.697667+0000","last_active":"2026-02-13T08:12:35.878322+0000","last_peered":"2026-02-13T08:12:35.878322+0000","last_clean":"2026-02-13T08:12:35.878322+0000","last_became_active":"2026-02-13T08:06:16.686038+0000","last_became_peered":"2026-02-13T08:06:16.686038+0000","last_unstale":"2026-02-13T08:12:35.878322+0000","last_undegraded":"2026-02-13T08:12:35.878322+0000","last_fullsized":"2026-02-13T08:12:35.878322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:57:25.281182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885553+0000","last_change":"2026-02-13T08:06:16.751888+0000","last_active":"2026-02-13T08:12:35.885553+0000","last_peered":"2026-02-13T08:12:35.885553+0000","last_clean":"2026-02-13T08:12:35.885553+0000","last_became_active":"2026-02-13T08:06:16.751147+0000","last_became_peered":"2026-02-13T08:06:16.751147+0000","last_unstale":"2026-02-13T08:12:35.885553+0000","last_undegraded":"2026-02-13T08:12:35.885553+0000","last_fullsized":"2026-02-13T08:12:35.885553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:19.232010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878598+0000","last_change":"2026-02-13T08:06:16.734907+0000","last_active":"2026-02-13T08:12:35.878598+0000","last_peered":"2026-02-13T08:12:35.878598+0000","last_clean":"2026-02-13T08:12:35.878598+0000","last_became_active":"2026-02-13T08:06:16.730470+0000","last_became_peered":"2026-02-13T08:06:16.730470+0000","last_unstale":"2026-02-13T08:12:35.878598+0000","last_undegraded":"2026-02-13T08:12:35.878598+0000","last_fullsized":"2026-02-13T08:12:35.878598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:11:47.396477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878647+0000","last_change":"2026-02-13T08:06:16.731624+0000","last_active":"2026-02-13T08:12:35.878647+0000","last_peered":"2026-02-13T08:12:35.878647+0000","last_clean":"2026-02-13T08:12:35.878647+0000","last_became_active":"2026-02-13T08:06:16.712405+0000","last_became_peered":"2026-02-13T08:06:16.712405+0000","last_unstale":"2026-02-13T08:12:35.878647+0000","last_undegraded":"2026-02-13T08:12:35.878647+0000","last_fullsized":"2026-02-13T08:12:35.878647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:50:12.211360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885718+0000","last_change":"2026-02-13T08:06:16.800945+0000","last_active":"2026-02-13T08:12:35.885718+0000","last_peered":"2026-02-13T08:12:35.885718+0000","last_clean":"2026-02-13T08:12:35.885718+0000","last_became_active":"2026-02-13T08:06:16.800468+0000","last_became_peered":"2026-02-13T08:06:16.800468+0000","last_unstale":"2026-02-13T08:12:35.885718+0000","last_undegraded":"2026-02-13T08:12:35.885718+0000","last_fullsized":"2026-02-13T08:12:35.885718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:27:10.279846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878438+0000","last_change":"2026-02-13T08:06:16.683317+0000","last_active":"2026-02-13T08:12:35.878438+0000","last_peered":"2026-02-13T08:12:35.878438+0000","last_clean":"2026-02-13T08:12:35.878438+0000","last_became_active":"2026-02-13T08:06:16.674984+0000","last_became_peered":"2026-02-13T08:06:16.674984+0000","last_unstale":"2026-02-13T08:12:35.878438+0000","last_undegraded":"2026-02-13T08:12:35.878438+0000","last_fullsized":"2026-02-13T08:12:35.878438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:06.968430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885481+0000","last_change":"2026-02-13T08:06:16.774443+0000","last_active":"2026-02-13T08:12:35.885481+0000","last_peered":"2026-02-13T08:12:35.885481+0000","last_clean":"2026-02-13T08:12:35.885481+0000","last_became_active":"2026-02-13T08:06:16.773780+0000","last_became_peered":"2026-02-13T08:06:16.773780+0000","last_unstale":"2026-02-13T08:12:35.885481+0000","last_undegraded":"2026-02-13T08:12:35.885481+0000","last_fullsized":"2026-02-13T08:12:35.885481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:19:52.327420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885657+0000","last_change":"2026-02-13T08:06:16.771409+0000","last_active":"2026-02-13T08:12:35.885657+0000","last_peered":"2026-02-13T08:12:35.885657+0000","last_clean":"2026-02-13T08:12:35.885657+0000","last_became_active":"2026-02-13T08:06:16.764687+0000","last_became_peered":"2026-02-13T08:06:16.764687+0000","last_unstale":"2026-02-13T08:12:35.885657+0000","last_undegraded":"2026-02-13T08:12:35.885657+0000","last_fullsized":"2026-02-13T08:12:35.885657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:57:37.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878375+0000","last_change":"2026-02-13T08:06:16.736308+0000","last_active":"2026-02-13T08:12:35.878375+0000","last_peered":"2026-02-13T08:12:35.878375+0000","last_clean":"2026-02-13T08:12:35.878375+0000","last_became_active":"2026-02-13T08:06:16.730093+0000","last_became_peered":"2026-02-13T08:06:16.730093+0000","last_unstale":"2026-02-13T08:12:35.878375+0000","last_undegraded":"2026-02-13T08:12:35.878375+0000","last_fullsized":"2026-02-13T08:12:35.878375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:48:15.958288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.443979+0000","last_change":"2026-02-13T08:06:16.727401+0000","last_active":"2026-02-13T08:12:35.443979+0000","last_peered":"2026-02-13T08:12:35.443979+0000","last_clean":"2026-02-13T08:12:35.443979+0000","last_became_active":"2026-02-13T08:06:16.716681+0000","last_became_peered":"2026-02-13T08:06:16.716681+0000","last_unstale":"2026-02-13T08:12:35.443979+0000","last_undegraded":"2026-02-13T08:12:35.443979+0000","last_fullsized":"2026-02-13T08:12:35.443979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:10:02.613952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885855+0000","last_change":"2026-02-13T08:05:48.689722+0000","last_active":"2026-02-13T08:12:35.885855+0000","last_peered":"2026-02-13T08:12:35.885855+0000","last_clean":"2026-02-13T08:12:35.885855+0000","last_became_active":"2026-02-13T08:05:46.332518+0000","last_became_peered":"2026-02-13T08:05:46.332518+0000","last_unstale":"2026-02-13T08:12:35.885855+0000","last_undegraded":"2026-02-13T08:12:35.885855+0000","last_fullsized":"2026-02-13T08:12:35.885855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:47.031472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027820299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878588+0000","last_change":"2026-02-13T08:06:16.713035+0000","last_active":"2026-02-13T08:12:35.878588+0000","last_peered":"2026-02-13T08:12:35.878588+0000","last_clean":"2026-02-13T08:12:35.878588+0000","last_became_active":"2026-02-13T08:06:16.697543+0000","last_became_peered":"2026-02-13T08:06:16.697543+0000","last_unstale":"2026-02-13T08:12:35.878588+0000","last_undegraded":"2026-02-13T08:12:35.878588+0000","last_fullsized":"2026-02-13T08:12:35.878588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:09:18.778241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878644+0000","last_change":"2026-02-13T08:05:48.241308+0000","last_active":"2026-02-13T08:12:35.878644+0000","last_peered":"2026-02-13T08:12:35.878644+0000","last_clean":"2026-02-13T08:12:35.878644+0000","last_became_active":"2026-02-13T08:05:46.238040+0000","last_became_peered":"2026-02-13T08:05:46.238040+0000","last_unstale":"2026-02-13T08:12:35.878644+0000","last_undegraded":"2026-02-13T08:12:35.878644+0000","last_fullsized":"2026-02-13T08:12:35.878644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:05.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040397499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885278+0000","last_change":"2026-02-13T08:06:16.788039+0000","last_active":"2026-02-13T08:12:35.885278+0000","last_peered":"2026-02-13T08:12:35.885278+0000","last_clean":"2026-02-13T08:12:35.885278+0000","last_became_active":"2026-02-13T08:06:16.787708+0000","last_became_peered":"2026-02-13T08:06:16.787708+0000","last_unstale":"2026-02-13T08:12:35.885278+0000","last_undegraded":"2026-02-13T08:12:35.885278+0000","last_fullsized":"2026-02-13T08:12:35.885278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:31:47.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885787+0000","last_change":"2026-02-13T08:05:48.689720+0000","last_active":"2026-02-13T08:12:35.885787+0000","last_peered":"2026-02-13T08:12:35.885787+0000","last_clean":"2026-02-13T08:12:35.885787+0000","last_became_active":"2026-02-13T08:05:46.419763+0000","last_became_peered":"2026-02-13T08:05:46.419763+0000","last_unstale":"2026-02-13T08:12:35.885787+0000","last_undegraded":"2026-02-13T08:12:35.885787+0000","last_fullsized":"2026-02-13T08:12:35.885787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:11.120130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031193600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"21'11","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451420+0000","last_change":"2026-02-13T08:06:16.765198+0000","last_active":"2026-02-13T08:12:35.451420+0000","last_peered":"2026-02-13T08:12:35.451420+0000","last_clean":"2026-02-13T08:12:35.451420+0000","last_became_active":"2026-02-13T08:06:16.764436+0000","last_became_peered":"2026-02-13T08:06:16.764436+0000","last_unstale":"2026-02-13T08:12:35.451420+0000","last_undegraded":"2026-02-13T08:12:35.451420+0000","last_fullsized":"2026-02-13T08:12:35.451420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:02.239330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878381+0000","last_change":"2026-02-13T08:05:48.241321+0000","last_active":"2026-02-13T08:12:35.878381+0000","last_peered":"2026-02-13T08:12:35.878381+0000","last_clean":"2026-02-13T08:12:35.878381+0000","last_became_active":"2026-02-13T08:05:46.325615+0000","last_became_peered":"2026-02-13T08:05:46.325615+0000","last_unstale":"2026-02-13T08:12:35.878381+0000","last_undegraded":"2026-02-13T08:12:35.878381+0000","last_fullsized":"2026-02-13T08:12:35.878381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:50:27.013203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041541599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885921+0000","last_change":"2026-02-13T08:06:16.770640+0000","last_active":"2026-02-13T08:12:35.885921+0000","last_peered":"2026-02-13T08:12:35.885921+0000","last_clean":"2026-02-13T08:12:35.885921+0000","last_became_active":"2026-02-13T08:06:16.755402+0000","last_became_peered":"2026-02-13T08:06:16.755402+0000","last_unstale":"2026-02-13T08:12:35.885921+0000","last_undegraded":"2026-02-13T08:12:35.885921+0000","last_fullsized":"2026-02-13T08:12:35.885921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:28:57.063487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885388+0000","last_change":"2026-02-13T08:05:48.335785+0000","last_active":"2026-02-13T08:12:35.885388+0000","last_peered":"2026-02-13T08:12:35.885388+0000","last_clean":"2026-02-13T08:12:35.885388+0000","last_became_active":"2026-02-13T08:05:46.332174+0000","last_became_peered":"2026-02-13T08:05:46.332174+0000","last_unstale":"2026-02-13T08:12:35.885388+0000","last_undegraded":"2026-02-13T08:12:35.885388+0000","last_fullsized":"2026-02-13T08:12:35.885388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:06.536002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000284605,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878462+0000","last_change":"2026-02-13T08:06:16.678986+0000","last_active":"2026-02-13T08:12:35.878462+0000","last_peered":"2026-02-13T08:12:35.878462+0000","last_clean":"2026-02-13T08:12:35.878462+0000","last_became_active":"2026-02-13T08:06:16.674970+0000","last_became_peered":"2026-02-13T08:06:16.674970+0000","last_unstale":"2026-02-13T08:12:35.878462+0000","last_undegraded":"2026-02-13T08:12:35.878462+0000","last_fullsized":"2026-02-13T08:12:35.878462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:00:29.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.443966+0000","last_change":"2026-02-13T08:05:48.241731+0000","last_active":"2026-02-13T08:12:35.443966+0000","last_peered":"2026-02-13T08:12:35.443966+0000","last_clean":"2026-02-13T08:12:35.443966+0000","last_became_active":"2026-02-13T08:05:46.236660+0000","last_became_peered":"2026-02-13T08:05:46.236660+0000","last_unstale":"2026-02-13T08:12:35.443966+0000","last_undegraded":"2026-02-13T08:12:35.443966+0000","last_fullsized":"2026-02-13T08:12:35.443966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:54:09.509002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024995099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451485+0000","last_change":"2026-02-13T08:06:16.777794+0000","last_active":"2026-02-13T08:12:35.451485+0000","last_peered":"2026-02-13T08:12:35.451485+0000","last_clean":"2026-02-13T08:12:35.451485+0000","last_became_active":"2026-02-13T08:06:16.775702+0000","last_became_peered":"2026-02-13T08:06:16.775702+0000","last_unstale":"2026-02-13T08:12:35.451485+0000","last_undegraded":"2026-02-13T08:12:35.451485+0000","last_fullsized":"2026-02-13T08:12:35.451485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:43:38.287112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":632,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885536+0000","last_change":"2026-02-13T08:05:48.689871+0000","last_active":"2026-02-13T08:12:35.885536+0000","last_peered":"2026-02-13T08:12:35.885536+0000","last_clean":"2026-02-13T08:12:35.885536+0000","last_became_active":"2026-02-13T08:05:46.331895+0000","last_became_peered":"2026-02-13T08:05:46.331895+0000","last_unstale":"2026-02-13T08:12:35.885536+0000","last_undegraded":"2026-02-13T08:12:35.885536+0000","last_fullsized":"2026-02-13T08:12:35.885536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:19.373004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878646+0000","last_change":"2026-02-13T08:06:16.686960+0000","last_active":"2026-02-13T08:12:35.878646+0000","last_peered":"2026-02-13T08:12:35.878646+0000","last_clean":"2026-02-13T08:12:35.878646+0000","last_became_active":"2026-02-13T08:06:16.677657+0000","last_became_peered":"2026-02-13T08:06:16.677657+0000","last_unstale":"2026-02-13T08:12:35.878646+0000","last_undegraded":"2026-02-13T08:12:35.878646+0000","last_fullsized":"2026-02-13T08:12:35.878646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:26:32.313932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":622,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885416+0000","last_change":"2026-02-13T08:05:48.335814+0000","last_active":"2026-02-13T08:12:35.885416+0000","last_peered":"2026-02-13T08:12:35.885416+0000","last_clean":"2026-02-13T08:12:35.885416+0000","last_became_active":"2026-02-13T08:05:46.331985+0000","last_became_peered":"2026-02-13T08:05:46.331985+0000","last_unstale":"2026-02-13T08:12:35.885416+0000","last_undegraded":"2026-02-13T08:12:35.885416+0000","last_fullsized":"2026-02-13T08:12:35.885416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:31:52.202154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030744700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":770,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885589+0000","last_change":"2026-02-13T08:05:43.034445+0000","last_active":"2026-02-13T08:12:35.885589+0000","last_peered":"2026-02-13T08:12:35.885589+0000","last_clean":"2026-02-13T08:12:35.885589+0000","last_became_active":"2026-02-13T08:05:43.032364+0000","last_became_peered":"2026-02-13T08:05:43.032364+0000","last_unstale":"2026-02-13T08:12:35.885589+0000","last_undegraded":"2026-02-13T08:12:35.885589+0000","last_fullsized":"2026-02-13T08:12:35.885589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_clean_scrub_stamp":"2026-02-13T08:05:41.931597+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:28.101837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885801+0000","last_change":"2026-02-13T08:06:16.776465+0000","last_active":"2026-02-13T08:12:35.885801+0000","last_peered":"2026-02-13T08:12:35.885801+0000","last_clean":"2026-02-13T08:12:35.885801+0000","last_became_active":"2026-02-13T08:06:16.772994+0000","last_became_peered":"2026-02-13T08:06:16.772994+0000","last_unstale":"2026-02-13T08:12:35.885801+0000","last_undegraded":"2026-02-13T08:12:35.885801+0000","last_fullsized":"2026-02-13T08:12:35.885801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:04:01.057076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451558+0000","last_change":"2026-02-13T08:06:16.786867+0000","last_active":"2026-02-13T08:12:35.451558+0000","last_peered":"2026-02-13T08:12:35.451558+0000","last_clean":"2026-02-13T08:12:35.451558+0000","last_became_active":"2026-02-13T08:06:16.784923+0000","last_became_peered":"2026-02-13T08:06:16.784923+0000","last_unstale":"2026-02-13T08:12:35.451558+0000","last_undegraded":"2026-02-13T08:12:35.451558+0000","last_fullsized":"2026-02-13T08:12:35.451558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:50:06.043735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444144+0000","last_change":"2026-02-13T08:06:16.707306+0000","last_active":"2026-02-13T08:12:35.444144+0000","last_peered":"2026-02-13T08:12:35.444144+0000","last_clean":"2026-02-13T08:12:35.444144+0000","last_became_active":"2026-02-13T08:06:16.693128+0000","last_became_peered":"2026-02-13T08:06:16.693128+0000","last_unstale":"2026-02-13T08:12:35.444144+0000","last_undegraded":"2026-02-13T08:12:35.444144+0000","last_fullsized":"2026-02-13T08:12:35.444144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:54.479190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878673+0000","last_change":"2026-02-13T08:06:16.707698+0000","last_active":"2026-02-13T08:12:35.878673+0000","last_peered":"2026-02-13T08:12:35.878673+0000","last_clean":"2026-02-13T08:12:35.878673+0000","last_became_active":"2026-02-13T08:06:16.706496+0000","last_became_peered":"2026-02-13T08:06:16.706496+0000","last_unstale":"2026-02-13T08:12:35.878673+0000","last_undegraded":"2026-02-13T08:12:35.878673+0000","last_fullsized":"2026-02-13T08:12:35.878673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:51:56.806272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444046+0000","last_change":"2026-02-13T08:06:16.715614+0000","last_active":"2026-02-13T08:12:35.444046+0000","last_peered":"2026-02-13T08:12:35.444046+0000","last_clean":"2026-02-13T08:12:35.444046+0000","last_became_active":"2026-02-13T08:06:16.704582+0000","last_became_peered":"2026-02-13T08:06:16.704582+0000","last_unstale":"2026-02-13T08:12:35.444046+0000","last_undegraded":"2026-02-13T08:12:35.444046+0000","last_fullsized":"2026-02-13T08:12:35.444046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:44:44.321422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878343+0000","last_change":"2026-02-13T08:06:16.704281+0000","last_active":"2026-02-13T08:12:35.878343+0000","last_peered":"2026-02-13T08:12:35.878343+0000","last_clean":"2026-02-13T08:12:35.878343+0000","last_became_active":"2026-02-13T08:06:16.703565+0000","last_became_peered":"2026-02-13T08:06:16.703565+0000","last_unstale":"2026-02-13T08:12:35.878343+0000","last_undegraded":"2026-02-13T08:12:35.878343+0000","last_fullsized":"2026-02-13T08:12:35.878343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:23:50.778453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444069+0000","last_change":"2026-02-13T08:06:16.723599+0000","last_active":"2026-02-13T08:12:35.444069+0000","last_peered":"2026-02-13T08:12:35.444069+0000","last_clean":"2026-02-13T08:12:35.444069+0000","last_became_active":"2026-02-13T08:06:16.714959+0000","last_became_peered":"2026-02-13T08:06:16.714959+0000","last_unstale":"2026-02-13T08:12:35.444069+0000","last_undegraded":"2026-02-13T08:12:35.444069+0000","last_fullsized":"2026-02-13T08:12:35.444069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:40:57.442734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878397+0000","last_change":"2026-02-13T08:06:16.712337+0000","last_active":"2026-02-13T08:12:35.878397+0000","last_peered":"2026-02-13T08:12:35.878397+0000","last_clean":"2026-02-13T08:12:35.878397+0000","last_became_active":"2026-02-13T08:06:16.706451+0000","last_became_peered":"2026-02-13T08:06:16.706451+0000","last_unstale":"2026-02-13T08:12:35.878397+0000","last_undegraded":"2026-02-13T08:12:35.878397+0000","last_fullsized":"2026-02-13T08:12:35.878397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:52:30.382122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878472+0000","last_change":"2026-02-13T08:06:16.741236+0000","last_active":"2026-02-13T08:12:35.878472+0000","last_peered":"2026-02-13T08:12:35.878472+0000","last_clean":"2026-02-13T08:12:35.878472+0000","last_became_active":"2026-02-13T08:06:16.737141+0000","last_became_peered":"2026-02-13T08:06:16.737141+0000","last_unstale":"2026-02-13T08:12:35.878472+0000","last_undegraded":"2026-02-13T08:12:35.878472+0000","last_fullsized":"2026-02-13T08:12:35.878472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:44:46.098224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885849+0000","last_change":"2026-02-13T08:06:16.794002+0000","last_active":"2026-02-13T08:12:35.885849+0000","last_peered":"2026-02-13T08:12:35.885849+0000","last_clean":"2026-02-13T08:12:35.885849+0000","last_became_active":"2026-02-13T08:06:16.791964+0000","last_became_peered":"2026-02-13T08:06:16.791964+0000","last_unstale":"2026-02-13T08:12:35.885849+0000","last_undegraded":"2026-02-13T08:12:35.885849+0000","last_fullsized":"2026-02-13T08:12:35.885849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:37.844323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451518+0000","last_change":"2026-02-13T08:06:16.765157+0000","last_active":"2026-02-13T08:12:35.451518+0000","last_peered":"2026-02-13T08:12:35.451518+0000","last_clean":"2026-02-13T08:12:35.451518+0000","last_became_active":"2026-02-13T08:06:16.764042+0000","last_became_peered":"2026-02-13T08:06:16.764042+0000","last_unstale":"2026-02-13T08:12:35.451518+0000","last_undegraded":"2026-02-13T08:12:35.451518+0000","last_fullsized":"2026-02-13T08:12:35.451518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:28:31.364151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885649+0000","last_change":"2026-02-13T08:06:16.799617+0000","last_active":"2026-02-13T08:12:35.885649+0000","last_peered":"2026-02-13T08:12:35.885649+0000","last_clean":"2026-02-13T08:12:35.885649+0000","last_became_active":"2026-02-13T08:06:16.799194+0000","last_became_peered":"2026-02-13T08:06:16.799194+0000","last_unstale":"2026-02-13T08:12:35.885649+0000","last_undegraded":"2026-02-13T08:12:35.885649+0000","last_fullsized":"2026-02-13T08:12:35.885649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:43:24.016414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":1180736,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640357,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":4613,"kb_used_meta":58426,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409441,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":4724473,"internal_metadata":59828487},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640357,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":3011,"kb_used_meta":60028,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409427,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":3083702,"internal_metadata":61469258},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640357,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66756,"kb_used_data":3700,"kb_used_omap":3015,"kb_used_meta":60024,"kb_avail":94305084,"statfs":{"total":96636764160,"available":96568406016,"internally_reserved":0,"allocated":3788800,"data_stored":2999790,"data_compressed":663918,"data_compressed_allocated":1351680,"data_compressed_original":2514840,"omap_allocated":3088323,"internal_metadata":61464637},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640357,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66708,"kb_used_data":3652,"kb_used_omap":2924,"kb_used_meta":60115,"kb_avail":94305132,"statfs":{"total":96636764160,"available":96568455168,"internally_reserved":0,"allocated":3739648,"data_stored":2409422,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":2994630,"internal_metadata":61558330},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640358,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":5013,"kb_used_meta":58026,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409441,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":5134330,"internal_metadata":59418630},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640357,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66760,"kb_used_data":3704,"kb_used_omap":2523,"kb_used_meta":60516,"kb_avail":94305080,"statfs":{"total":96636764160,"available":96568401920,"internally_reserved":0,"allocated":3792896,"data_stored":2999795,"data_compressed":663918,"data_compressed_allocated":1351680,"data_compressed_original":2514840,"omap_allocated":2583910,"internal_metadata":61969050},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T08:14:02.955 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T08:14:03.013 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient: get_monmap_and_config 2026-02-13T08:14:03.013 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient: build_initial_monmap 2026-02-13T08:14:03.013 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient: monmap: 2026-02-13T08:14:03.013 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:03.013 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.013 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:03.009749+0000 2026-02-13T08:14:03.013 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:03.009749+0000 2026-02-13T08:14:03.013 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:03.014 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.014 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:03.014 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:03.014 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:03.014 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.021 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 1 Processor -- start 2026-02-13T08:14:03.021 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 1 -- start start 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient: init 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient(hunting): picked mon.noname-b con 0x7f362808e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient(hunting): picked mon.noname-a con 0x7f362808ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient(hunting): picked mon.noname-c con 0x7f3628182080 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362808ae50 con 0x7f362808ef90 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362805c4f0 con 0x7f3628182080 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362808a790 con 0x7f362808e4b0 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient(hunting): authenticate will time out at 948.598577s 2026-02-13T08:14:03.022 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3626575640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f362808e4b0 0x7f362808e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57680/0 (socket says 10.20.193.104:57680) 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3626575640 1 -- 10.20.193.104:0/2180597394 learned_addr learned my addr 10.20.193.104:0/2180597394 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3829814709 0 0) 0x7f362808a790 con 0x7f362808e4b0 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): my global_id is 104147 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3614003620 con 0x7f362808e4b0 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549788011 0 0) 0x7f3610002920 con 0x7f362808ef90 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): my global_id is 94236 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f362808a790 con 0x7f362808ef90 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2656626297 0 0) 0x7f362805c4f0 con 0x7f3628182080 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient(hunting): my global_id is 74713 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3610002920 con 0x7f3628182080 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3907332241 0 0) 0x7f3614003620 con 0x7f362808e4b0 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 >> v1:10.20.193.119:6789/0 conn(0x7f3628182080 legacy=0x7f36281a2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 >> v1:10.20.193.104:6789/0 conn(0x7f362808ef90 legacy=0x7f3628180960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient: _finish_hunting 0 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 monclient: found mon.noname-b 2026-02-13T08:14:03.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f362808ba40 con 0x7f362808e4b0 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient: _finish_auth 0 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient: _check_auth_tickets 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f361c002e00 con 0x7f362808e4b0 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient: dump: 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.025 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 5 monclient: authenticate success, global_id 104147 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f361c003010 con 0x7f362808e4b0 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:03.026 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 1 -- 10.20.193.104:0/2180597394 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f361c003450 con 0x7f362808e4b0 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f3625573640 10 monclient: dump: 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.027 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 4 set_mon_vals no callback set 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 10 monclient: shutdown 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 1 -- 10.20.193.104:0/2180597394 >> v1:10.20.193.104:6790/0 conn(0x7f362808e4b0 legacy=0x7f362808e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 1 -- 10.20.193.104:0/2180597394 shutdown_connections 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 1 -- 10.20.193.104:0/2180597394 >> 10.20.193.104:0/2180597394 conn(0x7f3628051e80 msgr2=0x7f362808c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 1 -- 10.20.193.104:0/2180597394 shutdown_connections 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.004+0000 7f362ca93640 1 -- 10.20.193.104:0/2180597394 wait complete. 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient: build_initial_monmap 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient: monmap: 2026-02-13T08:14:03.028 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 librados: starting msgr at 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 librados: starting objecter 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 Processor -- start 2026-02-13T08:14:03.029 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 -- start start 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 librados: setting wanted keys 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 librados: calling monclient init 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient: init 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient(hunting): picked mon.noname-c con 0x7f362808e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient(hunting): picked mon.noname-b con 0x7f362808ef90 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient(hunting): picked mon.noname-a con 0x7f3628182080 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f362813a4b0 con 0x7f3628182080 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36280853f0 con 0x7f362808ef90 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36280892c0 con 0x7f362808e4b0 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:03.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient(hunting): authenticate will time out at 948.600980s 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f3626575640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f362808e4b0 0x7f362813fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57690/0 (socket says 10.20.193.104:57690) 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f3626575640 1 -- 10.20.193.104:0/1964875807 learned_addr learned my addr 10.20.193.104:0/1964875807 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 client.?.objecter ms_handle_connect 0x7f362808e4b0 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 client.?.objecter ms_handle_connect 0x7f3628182080 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146623489 0 0) 0x7f36280892c0 con 0x7f362808e4b0 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): my global_id is 104150 2026-02-13T08:14:03.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35f4003620 con 0x7f362808e4b0 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284559573 0 0) 0x7f362813a4b0 con 0x7f3628182080 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): my global_id is 94239 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36280892c0 con 0x7f3628182080 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 client.?.objecter ms_handle_connect 0x7f362808ef90 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2128067238 0 0) 0x7f35f4003620 con 0x7f362808e4b0 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f362813a4b0 con 0x7f362808e4b0 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f361c002d10 con 0x7f362808e4b0 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:03.032 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): dump: 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.033 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1152831472 0 0) 0x7f36280892c0 con 0x7f3628182080 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35f4003620 con 0x7f3628182080 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3618003420 con 0x7f3628182080 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): dump: 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.034 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42184585 0 0) 0x7f36280853f0 con 0x7f362808ef90 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient(hunting): my global_id is 74716 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36280892c0 con 0x7f362808ef90 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3444745059 0 0) 0x7f362813a4b0 con 0x7f362808e4b0 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 >> v1:10.20.193.119:6789/0 conn(0x7f362808ef90 legacy=0x7f36280845d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.035 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 >> v1:10.20.193.104:6789/0 conn(0x7f3628182080 legacy=0x7f3628084ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient: _finish_hunting 0 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 monclient: found mon.c 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3628086790 con 0x7f362808e4b0 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient: _finish_auth 0 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient: _check_auth_tickets 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 5 monclient: authenticate success, global_id 104150 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient: _renew_subs 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 -- 10.20.193.104:0/1964875807 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3628138430 con 0x7f362808e4b0 2026-02-13T08:14:03.036 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 client.104150.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient: _renew_subs 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 -- 10.20.193.104:0/1964875807 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f362813a1d0 con 0x7f362808e4b0 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 librados: init done 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f361c003010 con 0x7f362808e4b0 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f361c004d30 con 0x7f362808e4b0 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 monclient: dump: 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.037 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f3624d72640 4 set_mon_vals no callback set 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f362ca93640 1 -- 10.20.193.104:0/1964875807 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36281404d0 con 0x7f362808e4b0 2026-02-13T08:14:03.038 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f361c004f50 con 0x7f362808e4b0 2026-02-13T08:14:03.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f361c04a4c0 con 0x7f362808e4b0 2026-02-13T08:14:03.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 client.104150.objecter ms_dispatch2 0x7f3628000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:03.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 3 client.104150.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:03.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 3 client.104150.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:03.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 20 client.104150.objecter dump_active .. 0 homeless 2026-02-13T08:14:03.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f3625d74640 10 monclient: get_auth_request con 0x7f35f403b8c0 auth_method 0 2026-02-13T08:14:03.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.008+0000 7f360effd640 10 client.104150.objecter ms_handle_connect 0x7f35f403b8c0 2026-02-13T08:14:03.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.012+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f361c016d20 con 0x7f362808e4b0 2026-02-13T08:14:03.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.012+0000 7f360effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:03.039 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.012+0000 7f360effd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:03.098 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.088+0000 7f362ca93640 1 -- 10.20.193.104:0/1964875807 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36280380f0 con 0x7f35f403b8c0 2026-02-13T08:14:03.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f360effd640 1 -- 10.20.193.104:0/1964875807 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+114241 (unknown 2965378022 0 1200255480) 0x7f36280380f0 con 0x7f35f403b8c0 2026-02-13T08:14:03.101 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:14:03.102 INFO:teuthology.orchestra.run.trial104.stderr:dumped all 2026-02-13T08:14:03.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 10 librados: watch_flush enter 2026-02-13T08:14:03.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 10 librados: watch_flush exit 2026-02-13T08:14:03.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 20 client.104150.objecter shutdown clearing up homeless session... 2026-02-13T08:14:03.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 10 client.104150.objecter successfully canceled tick 2026-02-13T08:14:03.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 1 -- 10.20.193.104:0/1964875807 >> v1:10.20.193.119:6812/276487904 conn(0x7f35f403b8c0 legacy=0x7f35f405bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 10 monclient: shutdown 2026-02-13T08:14:03.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:03.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 1 -- 10.20.193.104:0/1964875807 >> v1:10.20.193.104:6790/0 conn(0x7f362808e4b0 legacy=0x7f362813fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 1 -- 10.20.193.104:0/1964875807 shutdown_connections 2026-02-13T08:14:03.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 1 -- 10.20.193.104:0/1964875807 >> 10.20.193.104:0/1964875807 conn(0x7f3628051e80 msgr2=0x7f36280878b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:03.104 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 1 -- 10.20.193.104:0/1964875807 shutdown_connections 2026-02-13T08:14:03.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 1 -- 10.20.193.104:0/1964875807 wait complete. 2026-02-13T08:14:03.105 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.096+0000 7f362ca93640 1 librados: shutdown 2026-02-13T08:14:03.111 INFO:teuthology.orchestra.run.trial104.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2026-02-13T08:14:01.932604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":158,"num_write_kb":2685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":400360,"kb_used_data":22024,"kb_used_omap":21102,"kb_used_meta":357137,"kb_avail":565830680,"statfs":{"total":579820584960,"available":579410616320,"internally_reserved":0,"allocated":22552576,"data_stored":15637316,"data_compressed":3933748,"data_compressed_allocated":7913472,"data_compressed_original":12727568,"omap_allocated":21609368,"internal_metadata":365708392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001162"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878544+0000","last_change":"2026-02-13T08:06:16.712986+0000","last_active":"2026-02-13T08:12:35.878544+0000","last_peered":"2026-02-13T08:12:35.878544+0000","last_clean":"2026-02-13T08:12:35.878544+0000","last_became_active":"2026-02-13T08:06:16.696600+0000","last_became_peered":"2026-02-13T08:06:16.696600+0000","last_unstale":"2026-02-13T08:12:35.878544+0000","last_undegraded":"2026-02-13T08:12:35.878544+0000","last_fullsized":"2026-02-13T08:12:35.878544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:46.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885618+0000","last_change":"2026-02-13T08:06:16.753790+0000","last_active":"2026-02-13T08:12:35.885618+0000","last_peered":"2026-02-13T08:12:35.885618+0000","last_clean":"2026-02-13T08:12:35.885618+0000","last_became_active":"2026-02-13T08:06:16.748269+0000","last_became_peered":"2026-02-13T08:06:16.748269+0000","last_unstale":"2026-02-13T08:12:35.885618+0000","last_undegraded":"2026-02-13T08:12:35.885618+0000","last_fullsized":"2026-02-13T08:12:35.885618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:07.517559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885651+0000","last_change":"2026-02-13T08:06:16.803804+0000","last_active":"2026-02-13T08:12:35.885651+0000","last_peered":"2026-02-13T08:12:35.885651+0000","last_clean":"2026-02-13T08:12:35.885651+0000","last_became_active":"2026-02-13T08:06:16.802337+0000","last_became_peered":"2026-02-13T08:06:16.802337+0000","last_unstale":"2026-02-13T08:12:35.885651+0000","last_undegraded":"2026-02-13T08:12:35.885651+0000","last_fullsized":"2026-02-13T08:12:35.885651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:11.597242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878322+0000","last_change":"2026-02-13T08:06:16.697667+0000","last_active":"2026-02-13T08:12:35.878322+0000","last_peered":"2026-02-13T08:12:35.878322+0000","last_clean":"2026-02-13T08:12:35.878322+0000","last_became_active":"2026-02-13T08:06:16.686038+0000","last_became_peered":"2026-02-13T08:06:16.686038+0000","last_unstale":"2026-02-13T08:12:35.878322+0000","last_undegraded":"2026-02-13T08:12:35.878322+0000","last_fullsized":"2026-02-13T08:12:35.878322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:57:25.281182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885553+0000","last_change":"2026-02-13T08:06:16.751888+0000","last_active":"2026-02-13T08:12:35.885553+0000","last_peered":"2026-02-13T08:12:35.885553+0000","last_clean":"2026-02-13T08:12:35.885553+0000","last_became_active":"2026-02-13T08:06:16.751147+0000","last_became_peered":"2026-02-13T08:06:16.751147+0000","last_unstale":"2026-02-13T08:12:35.885553+0000","last_undegraded":"2026-02-13T08:12:35.885553+0000","last_fullsized":"2026-02-13T08:12:35.885553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:19.232010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878598+0000","last_change":"2026-02-13T08:06:16.734907+0000","last_active":"2026-02-13T08:12:35.878598+0000","last_peered":"2026-02-13T08:12:35.878598+0000","last_clean":"2026-02-13T08:12:35.878598+0000","last_became_active":"2026-02-13T08:06:16.730470+0000","last_became_peered":"2026-02-13T08:06:16.730470+0000","last_unstale":"2026-02-13T08:12:35.878598+0000","last_undegraded":"2026-02-13T08:12:35.878598+0000","last_fullsized":"2026-02-13T08:12:35.878598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:11:47.396477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878647+0000","last_change":"2026-02-13T08:06:16.731624+0000","last_active":"2026-02-13T08:12:35.878647+0000","last_peered":"2026-02-13T08:12:35.878647+0000","last_clean":"2026-02-13T08:12:35.878647+0000","last_became_active":"2026-02-13T08:06:16.712405+0000","last_became_peered":"2026-02-13T08:06:16.712405+0000","last_unstale":"2026-02-13T08:12:35.878647+0000","last_undegraded":"2026-02-13T08:12:35.878647+0000","last_fullsized":"2026-02-13T08:12:35.878647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:50:12.211360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885718+0000","last_change":"2026-02-13T08:06:16.800945+0000","last_active":"2026-02-13T08:12:35.885718+0000","last_peered":"2026-02-13T08:12:35.885718+0000","last_clean":"2026-02-13T08:12:35.885718+0000","last_became_active":"2026-02-13T08:06:16.800468+0000","last_became_peered":"2026-02-13T08:06:16.800468+0000","last_unstale":"2026-02-13T08:12:35.885718+0000","last_undegraded":"2026-02-13T08:12:35.885718+0000","last_fullsized":"2026-02-13T08:12:35.885718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:27:10.279846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878438+0000","last_change":"2026-02-13T08:06:16.683317+0000","last_active":"2026-02-13T08:12:35.878438+0000","last_peered":"2026-02-13T08:12:35.878438+0000","last_clean":"2026-02-13T08:12:35.878438+0000","last_became_active":"2026-02-13T08:06:16.674984+0000","last_became_peered":"2026-02-13T08:06:16.674984+0000","last_unstale":"2026-02-13T08:12:35.878438+0000","last_undegraded":"2026-02-13T08:12:35.878438+0000","last_fullsized":"2026-02-13T08:12:35.878438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:06.968430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885481+0000","last_change":"2026-02-13T08:06:16.774443+0000","last_active":"2026-02-13T08:12:35.885481+0000","last_peered":"2026-02-13T08:12:35.885481+0000","last_clean":"2026-02-13T08:12:35.885481+0000","last_became_active":"2026-02-13T08:06:16.773780+0000","last_became_peered":"2026-02-13T08:06:16.773780+0000","last_unstale":"2026-02-13T08:12:35.885481+0000","last_undegraded":"2026-02-13T08:12:35.885481+0000","last_fullsized":"2026-02-13T08:12:35.885481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:19:52.327420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885657+0000","last_change":"2026-02-13T08:06:16.771409+0000","last_active":"2026-02-13T08:12:35.885657+0000","last_peered":"2026-02-13T08:12:35.885657+0000","last_clean":"2026-02-13T08:12:35.885657+0000","last_became_active":"2026-02-13T08:06:16.764687+0000","last_became_peered":"2026-02-13T08:06:16.764687+0000","last_unstale":"2026-02-13T08:12:35.885657+0000","last_undegraded":"2026-02-13T08:12:35.885657+0000","last_fullsized":"2026-02-13T08:12:35.885657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:57:37.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878375+0000","last_change":"2026-02-13T08:06:16.736308+0000","last_active":"2026-02-13T08:12:35.878375+0000","last_peered":"2026-02-13T08:12:35.878375+0000","last_clean":"2026-02-13T08:12:35.878375+0000","last_became_active":"2026-02-13T08:06:16.730093+0000","last_became_peered":"2026-02-13T08:06:16.730093+0000","last_unstale":"2026-02-13T08:12:35.878375+0000","last_undegraded":"2026-02-13T08:12:35.878375+0000","last_fullsized":"2026-02-13T08:12:35.878375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:48:15.958288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.443979+0000","last_change":"2026-02-13T08:06:16.727401+0000","last_active":"2026-02-13T08:12:35.443979+0000","last_peered":"2026-02-13T08:12:35.443979+0000","last_clean":"2026-02-13T08:12:35.443979+0000","last_became_active":"2026-02-13T08:06:16.716681+0000","last_became_peered":"2026-02-13T08:06:16.716681+0000","last_unstale":"2026-02-13T08:12:35.443979+0000","last_undegraded":"2026-02-13T08:12:35.443979+0000","last_fullsized":"2026-02-13T08:12:35.443979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:10:02.613952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885855+0000","last_change":"2026-02-13T08:05:48.689722+0000","last_active":"2026-02-13T08:12:35.885855+0000","last_peered":"2026-02-13T08:12:35.885855+0000","last_clean":"2026-02-13T08:12:35.885855+0000","last_became_active":"2026-02-13T08:05:46.332518+0000","last_became_peered":"2026-02-13T08:05:46.332518+0000","last_unstale":"2026-02-13T08:12:35.885855+0000","last_undegraded":"2026-02-13T08:12:35.885855+0000","last_fullsized":"2026-02-13T08:12:35.885855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:47.031472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027820299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878588+0000","last_change":"2026-02-13T08:06:16.713035+0000","last_active":"2026-02-13T08:12:35.878588+0000","last_peered":"2026-02-13T08:12:35.878588+0000","last_clean":"2026-02-13T08:12:35.878588+0000","last_became_active":"2026-02-13T08:06:16.697543+0000","last_became_peered":"2026-02-13T08:06:16.697543+0000","last_unstale":"2026-02-13T08:12:35.878588+0000","last_undegraded":"2026-02-13T08:12:35.878588+0000","last_fullsized":"2026-02-13T08:12:35.878588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:09:18.778241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878644+0000","last_change":"2026-02-13T08:05:48.241308+0000","last_active":"2026-02-13T08:12:35.878644+0000","last_peered":"2026-02-13T08:12:35.878644+0000","last_clean":"2026-02-13T08:12:35.878644+0000","last_became_active":"2026-02-13T08:05:46.238040+0000","last_became_peered":"2026-02-13T08:05:46.238040+0000","last_unstale":"2026-02-13T08:12:35.878644+0000","last_undegraded":"2026-02-13T08:12:35.878644+0000","last_fullsized":"2026-02-13T08:12:35.878644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:05.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040397499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885278+0000","last_change":"2026-02-13T08:06:16.788039+0000","last_active":"2026-02-13T08:12:35.885278+0000","last_peered":"2026-02-13T08:12:35.885278+0000","last_clean":"2026-02-13T08:12:35.885278+0000","last_became_active":"2026-02-13T08:06:16.787708+0000","last_became_peered":"2026-02-13T08:06:16.787708+0000","last_unstale":"2026-02-13T08:12:35.885278+0000","last_undegraded":"2026-02-13T08:12:35.885278+0000","last_fullsized":"2026-02-13T08:12:35.885278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:31:47.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885787+0000","last_change":"2026-02-13T08:05:48.689720+0000","last_active":"2026-02-13T08:12:35.885787+0000","last_peered":"2026-02-13T08:12:35.885787+0000","last_clean":"2026-02-13T08:12:35.885787+0000","last_became_active":"2026-02-13T08:05:46.419763+0000","last_became_peered":"2026-02-13T08:05:46.419763+0000","last_unstale":"2026-02-13T08:12:35.885787+0000","last_undegraded":"2026-02-13T08:12:35.885787+0000","last_fullsized":"2026-02-13T08:12:35.885787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:11.120130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031193600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"21'11","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451420+0000","last_change":"2026-02-13T08:06:16.765198+0000","last_active":"2026-02-13T08:12:35.451420+0000","last_peered":"2026-02-13T08:12:35.451420+0000","last_clean":"2026-02-13T08:12:35.451420+0000","last_became_active":"2026-02-13T08:06:16.764436+0000","last_became_peered":"2026-02-13T08:06:16.764436+0000","last_unstale":"2026-02-13T08:12:35.451420+0000","last_undegraded":"2026-02-13T08:12:35.451420+0000","last_fullsized":"2026-02-13T08:12:35.451420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:02.239330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878381+0000","last_change":"2026-02-13T08:05:48.241321+0000","last_active":"2026-02-13T08:12:35.878381+0000","last_peered":"2026-02-13T08:12:35.878381+0000","last_clean":"2026-02-13T08:12:35.878381+0000","last_became_active":"2026-02-13T08:05:46.325615+0000","last_became_peered":"2026-02-13T08:05:46.325615+0000","last_unstale":"2026-02-13T08:12:35.878381+0000","last_undegraded":"2026-02-13T08:12:35.878381+0000","last_fullsized":"2026-02-13T08:12:35.878381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:50:27.013203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041541599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885921+0000","last_change":"2026-02-13T08:06:16.770640+0000","last_active":"2026-02-13T08:12:35.885921+0000","last_peered":"2026-02-13T08:12:35.885921+0000","last_clean":"2026-02-13T08:12:35.885921+0000","last_became_active":"2026-02-13T08:06:16.755402+0000","last_became_peered":"2026-02-13T08:06:16.755402+0000","last_unstale":"2026-02-13T08:12:35.885921+0000","last_undegraded":"2026-02-13T08:12:35.885921+0000","last_fullsized":"2026-02-13T08:12:35.885921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:28:57.063487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885388+0000","last_change":"2026-02-13T08:05:48.335785+0000","last_active":"2026-02-13T08:12:35.885388+0000","last_peered":"2026-02-13T08:12:35.885388+0000","last_clean":"2026-02-13T08:12:35.885388+0000","last_became_active":"2026-02-13T08:05:46.332174+0000","last_became_peered":"2026-02-13T08:05:46.332174+0000","last_unstale":"2026-02-13T08:12:35.885388+0000","last_undegraded":"2026-02-13T08:12:35.885388+0000","last_fullsized":"2026-02-13T08:12:35.885388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:06.536002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000284605,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878462+0000","last_change":"2026-02-13T08:06:16.678986+0000","last_active":"2026-02-13T08:12:35.878462+0000","last_peered":"2026-02-13T08:12:35.878462+0000","last_clean":"2026-02-13T08:12:35.878462+0000","last_became_active":"2026-02-13T08:06:16.674970+0000","last_became_peered":"2026-02-13T08:06:16.674970+0000","last_unstale":"2026-02-13T08:12:35.878462+0000","last_undegraded":"2026-02-13T08:12:35.878462+0000","last_fullsized":"2026-02-13T08:12:35.878462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:00:29.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.443966+0000","last_change":"2026-02-13T08:05:48.241731+0000","last_active":"2026-02-13T08:12:35.443966+0000","last_peered":"2026-02-13T08:12:35.443966+0000","last_clean":"2026-02-13T08:12:35.443966+0000","last_became_active":"2026-02-13T08:05:46.236660+0000","last_became_peered":"2026-02-13T08:05:46.236660+0000","last_unstale":"2026-02-13T08:12:35.443966+0000","last_undegraded":"2026-02-13T08:12:35.443966+0000","last_fullsized":"2026-02-13T08:12:35.443966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:54:09.509002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024995099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451485+0000","last_change":"2026-02-13T08:06:16.777794+0000","last_active":"2026-02-13T08:12:35.451485+0000","last_peered":"2026-02-13T08:12:35.451485+0000","last_clean":"2026-02-13T08:12:35.451485+0000","last_became_active":"2026-02-13T08:06:16.775702+0000","last_became_peered":"2026-02-13T08:06:16.775702+0000","last_unstale":"2026-02-13T08:12:35.451485+0000","last_undegraded":"2026-02-13T08:12:35.451485+0000","last_fullsized":"2026-02-13T08:12:35.451485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:43:38.287112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":632,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885536+0000","last_change":"2026-02-13T08:05:48.689871+0000","last_active":"2026-02-13T08:12:35.885536+0000","last_peered":"2026-02-13T08:12:35.885536+0000","last_clean":"2026-02-13T08:12:35.885536+0000","last_became_active":"2026-02-13T08:05:46.331895+0000","last_became_peered":"2026-02-13T08:05:46.331895+0000","last_unstale":"2026-02-13T08:12:35.885536+0000","last_undegraded":"2026-02-13T08:12:35.885536+0000","last_fullsized":"2026-02-13T08:12:35.885536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:19.373004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878646+0000","last_change":"2026-02-13T08:06:16.686960+0000","last_active":"2026-02-13T08:12:35.878646+0000","last_peered":"2026-02-13T08:12:35.878646+0000","last_clean":"2026-02-13T08:12:35.878646+0000","last_became_active":"2026-02-13T08:06:16.677657+0000","last_became_peered":"2026-02-13T08:06:16.677657+0000","last_unstale":"2026-02-13T08:12:35.878646+0000","last_undegraded":"2026-02-13T08:12:35.878646+0000","last_fullsized":"2026-02-13T08:12:35.878646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:26:32.313932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":622,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885416+0000","last_change":"2026-02-13T08:05:48.335814+0000","last_active":"2026-02-13T08:12:35.885416+0000","last_peered":"2026-02-13T08:12:35.885416+0000","last_clean":"2026-02-13T08:12:35.885416+0000","last_became_active":"2026-02-13T08:05:46.331985+0000","last_became_peered":"2026-02-13T08:05:46.331985+0000","last_unstale":"2026-02-13T08:12:35.885416+0000","last_undegraded":"2026-02-13T08:12:35.885416+0000","last_fullsized":"2026-02-13T08:12:35.885416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:31:52.202154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030744700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":770,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885589+0000","last_change":"2026-02-13T08:05:43.034445+0000","last_active":"2026-02-13T08:12:35.885589+0000","last_peered":"2026-02-13T08:12:35.885589+0000","last_clean":"2026-02-13T08:12:35.885589+0000","last_became_active":"2026-02-13T08:05:43.032364+0000","last_became_peered":"2026-02-13T08:05:43.032364+0000","last_unstale":"2026-02-13T08:12:35.885589+0000","last_undegraded":"2026-02-13T08:12:35.885589+0000","last_fullsized":"2026-02-13T08:12:35.885589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_clean_scrub_stamp":"2026-02-13T08:05:41.931597+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:28.101837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885801+0000","last_change":"2026-02-13T08:06:16.776465+0000","last_active":"2026-02-13T08:12:35.885801+0000","last_peered":"2026-02-13T08:12:35.885801+0000","last_clean":"2026-02-13T08:12:35.885801+0000","last_became_active":"2026-02-13T08:06:16.772994+0000","last_became_peered":"2026-02-13T08:06:16.772994+0000","last_unstale":"2026-02-13T08:12:35.885801+0000","last_undegraded":"2026-02-13T08:12:35.885801+0000","last_fullsized":"2026-02-13T08:12:35.885801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:04:01.057076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451558+0000","last_change":"2026-02-13T08:06:16.786867+0000","last_active":"2026-02-13T08:12:35.451558+0000","last_peered":"2026-02-13T08:12:35.451558+0000","last_clean":"2026-02-13T08:12:35.451558+0000","last_became_active":"2026-02-13T08:06:16.784923+0000","last_became_peered":"2026-02-13T08:06:16.784923+0000","last_unstale":"2026-02-13T08:12:35.451558+0000","last_undegraded":"2026-02-13T08:12:35.451558+0000","last_fullsized":"2026-02-13T08:12:35.451558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:50:06.043735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444144+0000","last_change":"2026-02-13T08:06:16.707306+0000","last_active":"2026-02-13T08:12:35.444144+0000","last_peered":"2026-02-13T08:12:35.444144+0000","last_clean":"2026-02-13T08:12:35.444144+0000","last_became_active":"2026-02-13T08:06:16.693128+0000","last_became_peered":"2026-02-13T08:06:16.693128+0000","last_unstale":"2026-02-13T08:12:35.444144+0000","last_undegraded":"2026-02-13T08:12:35.444144+0000","last_fullsized":"2026-02-13T08:12:35.444144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:54.479190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878673+0000","last_change":"2026-02-13T08:06:16.707698+0000","last_active":"2026-02-13T08:12:35.878673+0000","last_peered":"2026-02-13T08:12:35.878673+0000","last_clean":"2026-02-13T08:12:35.878673+0000","last_became_active":"2026-02-13T08:06:16.706496+0000","last_became_peered":"2026-02-13T08:06:16.706496+0000","last_unstale":"2026-02-13T08:12:35.878673+0000","last_undegraded":"2026-02-13T08:12:35.878673+0000","last_fullsized":"2026-02-13T08:12:35.878673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:51:56.806272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444046+0000","last_change":"2026-02-13T08:06:16.715614+0000","last_active":"2026-02-13T08:12:35.444046+0000","last_peered":"2026-02-13T08:12:35.444046+0000","last_clean":"2026-02-13T08:12:35.444046+0000","last_became_active":"2026-02-13T08:06:16.704582+0000","last_became_peered":"2026-02-13T08:06:16.704582+0000","last_unstale":"2026-02-13T08:12:35.444046+0000","last_undegraded":"2026-02-13T08:12:35.444046+0000","last_fullsized":"2026-02-13T08:12:35.444046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:44:44.321422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878343+0000","last_change":"2026-02-13T08:06:16.704281+0000","last_active":"2026-02-13T08:12:35.878343+0000","last_peered":"2026-02-13T08:12:35.878343+0000","last_clean":"2026-02-13T08:12:35.878343+0000","last_became_active":"2026-02-13T08:06:16.703565+0000","last_became_peered":"2026-02-13T08:06:16.703565+0000","last_unstale":"2026-02-13T08:12:35.878343+0000","last_undegraded":"2026-02-13T08:12:35.878343+0000","last_fullsized":"2026-02-13T08:12:35.878343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:23:50.778453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444069+0000","last_change":"2026-02-13T08:06:16.723599+0000","last_active":"2026-02-13T08:12:35.444069+0000","last_peered":"2026-02-13T08:12:35.444069+0000","last_clean":"2026-02-13T08:12:35.444069+0000","last_became_active":"2026-02-13T08:06:16.714959+0000","last_became_peered":"2026-02-13T08:06:16.714959+0000","last_unstale":"2026-02-13T08:12:35.444069+0000","last_undegraded":"2026-02-13T08:12:35.444069+0000","last_fullsized":"2026-02-13T08:12:35.444069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:40:57.442734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878397+0000","last_change":"2026-02-13T08:06:16.712337+0000","last_active":"2026-02-13T08:12:35.878397+0000","last_peered":"2026-02-13T08:12:35.878397+0000","last_clean":"2026-02-13T08:12:35.878397+0000","last_became_active":"2026-02-13T08:06:16.706451+0000","last_became_peered":"2026-02-13T08:06:16.706451+0000","last_unstale":"2026-02-13T08:12:35.878397+0000","last_undegraded":"2026-02-13T08:12:35.878397+0000","last_fullsized":"2026-02-13T08:12:35.878397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:52:30.382122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878472+0000","last_change":"2026-02-13T08:06:16.741236+0000","last_active":"2026-02-13T08:12:35.878472+0000","last_peered":"2026-02-13T08:12:35.878472+0000","last_clean":"2026-02-13T08:12:35.878472+0000","last_became_active":"2026-02-13T08:06:16.737141+0000","last_became_peered":"2026-02-13T08:06:16.737141+0000","last_unstale":"2026-02-13T08:12:35.878472+0000","last_undegraded":"2026-02-13T08:12:35.878472+0000","last_fullsized":"2026-02-13T08:12:35.878472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:44:46.098224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885849+0000","last_change":"2026-02-13T08:06:16.794002+0000","last_active":"2026-02-13T08:12:35.885849+0000","last_peered":"2026-02-13T08:12:35.885849+0000","last_clean":"2026-02-13T08:12:35.885849+0000","last_became_active":"2026-02-13T08:06:16.791964+0000","last_became_peered":"2026-02-13T08:06:16.791964+0000","last_unstale":"2026-02-13T08:12:35.885849+0000","last_undegraded":"2026-02-13T08:12:35.885849+0000","last_fullsized":"2026-02-13T08:12:35.885849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:37.844323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451518+0000","last_change":"2026-02-13T08:06:16.765157+0000","last_active":"2026-02-13T08:12:35.451518+0000","last_peered":"2026-02-13T08:12:35.451518+0000","last_clean":"2026-02-13T08:12:35.451518+0000","last_became_active":"2026-02-13T08:06:16.764042+0000","last_became_peered":"2026-02-13T08:06:16.764042+0000","last_unstale":"2026-02-13T08:12:35.451518+0000","last_undegraded":"2026-02-13T08:12:35.451518+0000","last_fullsized":"2026-02-13T08:12:35.451518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:28:31.364151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885649+0000","last_change":"2026-02-13T08:06:16.799617+0000","last_active":"2026-02-13T08:12:35.885649+0000","last_peered":"2026-02-13T08:12:35.885649+0000","last_clean":"2026-02-13T08:12:35.885649+0000","last_became_active":"2026-02-13T08:06:16.799194+0000","last_became_peered":"2026-02-13T08:06:16.799194+0000","last_unstale":"2026-02-13T08:12:35.885649+0000","last_undegraded":"2026-02-13T08:12:35.885649+0000","last_fullsized":"2026-02-13T08:12:35.885649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:43:24.016414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":1180736,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640357,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":4613,"kb_used_meta":58426,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409441,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":4724473,"internal_metadata":59828487},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640357,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":3011,"kb_used_meta":60028,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409427,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":3083702,"internal_metadata":61469258},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640357,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66756,"kb_used_data":3700,"kb_used_omap":3015,"kb_used_meta":60024,"kb_avail":94305084,"statfs":{"total":96636764160,"available":96568406016,"internally_reserved":0,"allocated":3788800,"data_stored":2999790,"data_compressed":663918,"data_compressed_allocated":1351680,"data_compressed_original":2514840,"omap_allocated":3088323,"internal_metadata":61464637},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640357,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66708,"kb_used_data":3652,"kb_used_omap":2924,"kb_used_meta":60115,"kb_avail":94305132,"statfs":{"total":96636764160,"available":96568455168,"internally_reserved":0,"allocated":3739648,"data_stored":2409422,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":2994630,"internal_metadata":61558330},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640358,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":5013,"kb_used_meta":58026,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409441,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":5134330,"internal_metadata":59418630},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640357,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66760,"kb_used_data":3704,"kb_used_omap":2523,"kb_used_meta":60516,"kb_avail":94305080,"statfs":{"total":96636764160,"available":96568401920,"internally_reserved":0,"allocated":3792896,"data_stored":2999795,"data_compressed":663918,"data_compressed_allocated":1351680,"data_compressed_original":2514840,"omap_allocated":2583910,"internal_metadata":61969050},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T08:14:03.114 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-13T08:14:03.115 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T08:14:03.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.172+0000 7f76fe6ff640 10 monclient: get_monmap_and_config 2026-02-13T08:14:03.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.172+0000 7f76fe6ff640 10 monclient: build_initial_monmap 2026-02-13T08:14:03.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.172+0000 7f76fe6ff640 10 monclient: monmap: 2026-02-13T08:14:03.183 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:03.183 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.183 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:03.179456+0000 2026-02-13T08:14:03.183 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:03.179456+0000 2026-02-13T08:14:03.183 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:03.183 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.183 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:03.183 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:03.184 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:03.184 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.172+0000 7f76fe6ff640 1 Processor -- start 2026-02-13T08:14:03.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- start start 2026-02-13T08:14:03.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: init 2026-02-13T08:14:03.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:03.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:14:03.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient(hunting): picked mon.noname-b con 0x7f76f808e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:03.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient(hunting): picked mon.noname-c con 0x7f76f808ef90 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:03.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient(hunting): picked mon.noname-a con 0x7f76f817fe50 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:03.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f8089fa0 con 0x7f76f817fe50 2026-02-13T08:14:03.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f8089760 con 0x7f76f808ef90 2026-02-13T08:14:03.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f808af90 con 0x7f76f808e4b0 2026-02-13T08:14:03.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:03.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient(hunting): authenticate will time out at 948.768491s 2026-02-13T08:14:03.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f7fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f76f808e4b0 0x7f76f808e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57706/0 (socket says 10.20.193.104:57706) 2026-02-13T08:14:03.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f7fff640 1 -- 10.20.193.104:0/3405246296 learned_addr learned my addr 10.20.193.104:0/3405246296 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:03.192 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 -- 10.20.193.104:0/3405246296 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2864281843 0 0) 0x7f76f808af90 con 0x7f76f808e4b0 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient(hunting): my global_id is 104153 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 -- 10.20.193.104:0/3405246296 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76dc003620 con 0x7f76f808e4b0 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 -- 10.20.193.104:0/3405246296 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4180414445 0 0) 0x7f76f8089fa0 con 0x7f76f817fe50 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient(hunting): my global_id is 94242 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 -- 10.20.193.104:0/3405246296 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76f808af90 con 0x7f76f817fe50 2026-02-13T08:14:03.193 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 -- 10.20.193.104:0/3405246296 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 815636584 0 0) 0x7f76f808af90 con 0x7f76f817fe50 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 -- 10.20.193.104:0/3405246296 >> v1:10.20.193.104:6790/0 conn(0x7f76f808e4b0 legacy=0x7f76f808e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 -- 10.20.193.104:0/3405246296 >> v1:10.20.193.119:6789/0 conn(0x7f76f808ef90 legacy=0x7f76f817e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 monclient: found mon.noname-a 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 -- 10.20.193.104:0/3405246296 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f808b270 con 0x7f76f817fe50 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient: _finish_auth 0 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 -- 10.20.193.104:0/3405246296 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f76ec003180 con 0x7f76f817fe50 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:03.194 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient: dump: 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 5 monclient: authenticate success, global_id 94242 2026-02-13T08:14:03.195 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:03.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 -- 10.20.193.104:0/3405246296 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76ec003440 con 0x7f76f817fe50 2026-02-13T08:14:03.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:03.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 1 -- 10.20.193.104:0/3405246296 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f76ec003880 con 0x7f76f817fe50 2026-02-13T08:14:03.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:03.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:03.196 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f6ffd640 10 monclient: dump: 2026-02-13T08:14:03.196 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.196 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.196 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.196 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.196 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 4 set_mon_vals no callback set 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: shutdown 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- 10.20.193.104:0/3405246296 >> v1:10.20.193.104:6789/0 conn(0x7f76f817fe50 legacy=0x7f76f81a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- 10.20.193.104:0/3405246296 shutdown_connections 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- 10.20.193.104:0/3405246296 >> 10.20.193.104:0/3405246296 conn(0x7f76f8051e80 msgr2=0x7f76f808c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:03.197 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- 10.20.193.104:0/3405246296 shutdown_connections 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- 10.20.193.104:0/3405246296 wait complete. 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: build_initial_monmap 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: monmap: 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:03.198 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 librados: starting msgr at 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 librados: starting objecter 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 Processor -- start 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- start start 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 librados: setting wanted keys 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 librados: calling monclient init 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: init 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient(hunting): picked mon.noname-a con 0x7f76f808e4b0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:03.199 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient(hunting): picked mon.noname-c con 0x7f76f808ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient(hunting): picked mon.noname-b con 0x7f76f817fe50 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f807e7a0 con 0x7f76f808e4b0 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f8086790 con 0x7f76f817fe50 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76f805ca10 con 0x7f76f808ef90 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient(hunting): authenticate will time out at 948.770849s 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f7fff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f76f808e4b0 0x7f76f8084d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44970/0 (socket says 10.20.193.104:44970) 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f7fff640 1 -- 10.20.193.104:0/2906160066 learned_addr learned my addr 10.20.193.104:0/2906160066 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 client.?.objecter ms_handle_connect 0x7f76f808e4b0 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 client.?.objecter ms_handle_connect 0x7f76f808ef90 2026-02-13T08:14:03.200 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3628633117 0 0) 0x7f76f805ca10 con 0x7f76f808ef90 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): my global_id is 104156 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76c8003620 con 0x7f76f808ef90 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986649694 0 0) 0x7f76f807e7a0 con 0x7f76f808e4b0 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): my global_id is 94245 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76f805ca10 con 0x7f76f808e4b0 2026-02-13T08:14:03.201 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1961313612 0 0) 0x7f76f805ca10 con 0x7f76f808e4b0 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76f807e7a0 con 0x7f76f808e4b0 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f76e40031d0 con 0x7f76f808e4b0 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): dump: 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.202 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1841535904 0 0) 0x7f76c8003620 con 0x7f76f808ef90 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76f805ca10 con 0x7f76f808ef90 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f76e80030a0 con 0x7f76f808ef90 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient(hunting): dump: 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.203 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2826064307 0 0) 0x7f76f807e7a0 con 0x7f76f808e4b0 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 >> v1:10.20.193.104:6790/0 conn(0x7f76f808ef90 legacy=0x7f76f816d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 >> v1:10.20.193.119:6789/0 conn(0x7f76f817fe50 legacy=0x7f76f816e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient: _finish_hunting 0 2026-02-13T08:14:03.204 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 monclient: found mon.a 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76f8059f00 con 0x7f76f808e4b0 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient: _finish_auth 0 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient: _check_auth_tickets 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 5 monclient: authenticate success, global_id 94245 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: _renew_subs 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- 10.20.193.104:0/2906160066 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f76f807e4c0 con 0x7f76f808e4b0 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 client.94245.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:03.205 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: _renew_subs 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- 10.20.193.104:0/2906160066 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f76f8085430 con 0x7f76f808e4b0 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 librados: init done 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76e4003500 con 0x7f76f808e4b0 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f76e4004d30 con 0x7f76f808e4b0 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 10 monclient: dump: 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.206 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f67fc640 4 set_mon_vals no callback set 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76fe6ff640 1 -- 10.20.193.104:0/2906160066 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f8061860 con 0x7f76f808e4b0 2026-02-13T08:14:03.207 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.176+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f76e4010d40 con 0x7f76f808e4b0 2026-02-13T08:14:03.208 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.180+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f76e404a540 con 0x7f76f808e4b0 2026-02-13T08:14:03.208 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.180+0000 7f76f4ff9640 10 client.94245.objecter ms_dispatch2 0x7f76f8000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:03.208 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.180+0000 7f76f4ff9640 3 client.94245.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:03.208 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.180+0000 7f76f4ff9640 3 client.94245.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:03.208 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.180+0000 7f76f4ff9640 20 client.94245.objecter dump_active .. 0 homeless 2026-02-13T08:14:03.208 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.180+0000 7f76f77fe640 10 monclient: get_auth_request con 0x7f76c803b840 auth_method 0 2026-02-13T08:14:03.208 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.180+0000 7f76f4ff9640 10 client.94245.objecter ms_handle_connect 0x7f76c803b840 2026-02-13T08:14:03.208 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.184+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f76e4016c60 con 0x7f76f808e4b0 2026-02-13T08:14:03.208 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.184+0000 7f76f4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:03.208 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.184+0000 7f76f4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:03.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.264+0000 7f76fe6ff640 1 -- 10.20.193.104:0/2906160066 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76f807be60 con 0x7f76c803b840 2026-02-13T08:14:03.275 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76f4ff9640 1 -- 10.20.193.104:0/2906160066 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+114241 (unknown 2965378022 0 1200255480) 0x7f76f807be60 con 0x7f76c803b840 2026-02-13T08:14:03.276 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:14:03.277 INFO:teuthology.orchestra.run.trial104.stderr:dumped all 2026-02-13T08:14:03.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 10 librados: watch_flush enter 2026-02-13T08:14:03.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 10 librados: watch_flush exit 2026-02-13T08:14:03.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 20 client.94245.objecter shutdown clearing up homeless session... 2026-02-13T08:14:03.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 10 client.94245.objecter successfully canceled tick 2026-02-13T08:14:03.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 1 -- 10.20.193.104:0/2906160066 >> v1:10.20.193.119:6812/276487904 conn(0x7f76c803b840 legacy=0x7f76c805bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 10 monclient: shutdown 2026-02-13T08:14:03.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:03.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 1 -- 10.20.193.104:0/2906160066 >> v1:10.20.193.104:6789/0 conn(0x7f76f808e4b0 legacy=0x7f76f8084d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 1 -- 10.20.193.104:0/2906160066 shutdown_connections 2026-02-13T08:14:03.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 1 -- 10.20.193.104:0/2906160066 >> 10.20.193.104:0/2906160066 conn(0x7f76f8051e80 msgr2=0x7f76f805c170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:03.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 1 -- 10.20.193.104:0/2906160066 shutdown_connections 2026-02-13T08:14:03.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 1 -- 10.20.193.104:0/2906160066 wait complete. 2026-02-13T08:14:03.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.268+0000 7f76fe6ff640 1 librados: shutdown 2026-02-13T08:14:03.286 INFO:teuthology.orchestra.run.trial104.stdout:{"pg_ready":true,"pg_map":{"version":568,"stamp":"2026-02-13T08:14:01.932604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":158,"num_write_kb":2685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":400360,"kb_used_data":22024,"kb_used_omap":21102,"kb_used_meta":357137,"kb_avail":565830680,"statfs":{"total":579820584960,"available":579410616320,"internally_reserved":0,"allocated":22552576,"data_stored":15637316,"data_compressed":3933748,"data_compressed_allocated":7913472,"data_compressed_original":12727568,"omap_allocated":21609368,"internal_metadata":365708392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001162"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878544+0000","last_change":"2026-02-13T08:06:16.712986+0000","last_active":"2026-02-13T08:12:35.878544+0000","last_peered":"2026-02-13T08:12:35.878544+0000","last_clean":"2026-02-13T08:12:35.878544+0000","last_became_active":"2026-02-13T08:06:16.696600+0000","last_became_peered":"2026-02-13T08:06:16.696600+0000","last_unstale":"2026-02-13T08:12:35.878544+0000","last_undegraded":"2026-02-13T08:12:35.878544+0000","last_fullsized":"2026-02-13T08:12:35.878544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:46.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885618+0000","last_change":"2026-02-13T08:06:16.753790+0000","last_active":"2026-02-13T08:12:35.885618+0000","last_peered":"2026-02-13T08:12:35.885618+0000","last_clean":"2026-02-13T08:12:35.885618+0000","last_became_active":"2026-02-13T08:06:16.748269+0000","last_became_peered":"2026-02-13T08:06:16.748269+0000","last_unstale":"2026-02-13T08:12:35.885618+0000","last_undegraded":"2026-02-13T08:12:35.885618+0000","last_fullsized":"2026-02-13T08:12:35.885618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:07.517559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885651+0000","last_change":"2026-02-13T08:06:16.803804+0000","last_active":"2026-02-13T08:12:35.885651+0000","last_peered":"2026-02-13T08:12:35.885651+0000","last_clean":"2026-02-13T08:12:35.885651+0000","last_became_active":"2026-02-13T08:06:16.802337+0000","last_became_peered":"2026-02-13T08:06:16.802337+0000","last_unstale":"2026-02-13T08:12:35.885651+0000","last_undegraded":"2026-02-13T08:12:35.885651+0000","last_fullsized":"2026-02-13T08:12:35.885651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:11.597242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878322+0000","last_change":"2026-02-13T08:06:16.697667+0000","last_active":"2026-02-13T08:12:35.878322+0000","last_peered":"2026-02-13T08:12:35.878322+0000","last_clean":"2026-02-13T08:12:35.878322+0000","last_became_active":"2026-02-13T08:06:16.686038+0000","last_became_peered":"2026-02-13T08:06:16.686038+0000","last_unstale":"2026-02-13T08:12:35.878322+0000","last_undegraded":"2026-02-13T08:12:35.878322+0000","last_fullsized":"2026-02-13T08:12:35.878322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:57:25.281182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885553+0000","last_change":"2026-02-13T08:06:16.751888+0000","last_active":"2026-02-13T08:12:35.885553+0000","last_peered":"2026-02-13T08:12:35.885553+0000","last_clean":"2026-02-13T08:12:35.885553+0000","last_became_active":"2026-02-13T08:06:16.751147+0000","last_became_peered":"2026-02-13T08:06:16.751147+0000","last_unstale":"2026-02-13T08:12:35.885553+0000","last_undegraded":"2026-02-13T08:12:35.885553+0000","last_fullsized":"2026-02-13T08:12:35.885553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:19.232010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878598+0000","last_change":"2026-02-13T08:06:16.734907+0000","last_active":"2026-02-13T08:12:35.878598+0000","last_peered":"2026-02-13T08:12:35.878598+0000","last_clean":"2026-02-13T08:12:35.878598+0000","last_became_active":"2026-02-13T08:06:16.730470+0000","last_became_peered":"2026-02-13T08:06:16.730470+0000","last_unstale":"2026-02-13T08:12:35.878598+0000","last_undegraded":"2026-02-13T08:12:35.878598+0000","last_fullsized":"2026-02-13T08:12:35.878598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:11:47.396477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878647+0000","last_change":"2026-02-13T08:06:16.731624+0000","last_active":"2026-02-13T08:12:35.878647+0000","last_peered":"2026-02-13T08:12:35.878647+0000","last_clean":"2026-02-13T08:12:35.878647+0000","last_became_active":"2026-02-13T08:06:16.712405+0000","last_became_peered":"2026-02-13T08:06:16.712405+0000","last_unstale":"2026-02-13T08:12:35.878647+0000","last_undegraded":"2026-02-13T08:12:35.878647+0000","last_fullsized":"2026-02-13T08:12:35.878647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:50:12.211360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885718+0000","last_change":"2026-02-13T08:06:16.800945+0000","last_active":"2026-02-13T08:12:35.885718+0000","last_peered":"2026-02-13T08:12:35.885718+0000","last_clean":"2026-02-13T08:12:35.885718+0000","last_became_active":"2026-02-13T08:06:16.800468+0000","last_became_peered":"2026-02-13T08:06:16.800468+0000","last_unstale":"2026-02-13T08:12:35.885718+0000","last_undegraded":"2026-02-13T08:12:35.885718+0000","last_fullsized":"2026-02-13T08:12:35.885718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:27:10.279846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878438+0000","last_change":"2026-02-13T08:06:16.683317+0000","last_active":"2026-02-13T08:12:35.878438+0000","last_peered":"2026-02-13T08:12:35.878438+0000","last_clean":"2026-02-13T08:12:35.878438+0000","last_became_active":"2026-02-13T08:06:16.674984+0000","last_became_peered":"2026-02-13T08:06:16.674984+0000","last_unstale":"2026-02-13T08:12:35.878438+0000","last_undegraded":"2026-02-13T08:12:35.878438+0000","last_fullsized":"2026-02-13T08:12:35.878438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:06.968430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885481+0000","last_change":"2026-02-13T08:06:16.774443+0000","last_active":"2026-02-13T08:12:35.885481+0000","last_peered":"2026-02-13T08:12:35.885481+0000","last_clean":"2026-02-13T08:12:35.885481+0000","last_became_active":"2026-02-13T08:06:16.773780+0000","last_became_peered":"2026-02-13T08:06:16.773780+0000","last_unstale":"2026-02-13T08:12:35.885481+0000","last_undegraded":"2026-02-13T08:12:35.885481+0000","last_fullsized":"2026-02-13T08:12:35.885481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:19:52.327420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885657+0000","last_change":"2026-02-13T08:06:16.771409+0000","last_active":"2026-02-13T08:12:35.885657+0000","last_peered":"2026-02-13T08:12:35.885657+0000","last_clean":"2026-02-13T08:12:35.885657+0000","last_became_active":"2026-02-13T08:06:16.764687+0000","last_became_peered":"2026-02-13T08:06:16.764687+0000","last_unstale":"2026-02-13T08:12:35.885657+0000","last_undegraded":"2026-02-13T08:12:35.885657+0000","last_fullsized":"2026-02-13T08:12:35.885657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:57:37.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878375+0000","last_change":"2026-02-13T08:06:16.736308+0000","last_active":"2026-02-13T08:12:35.878375+0000","last_peered":"2026-02-13T08:12:35.878375+0000","last_clean":"2026-02-13T08:12:35.878375+0000","last_became_active":"2026-02-13T08:06:16.730093+0000","last_became_peered":"2026-02-13T08:06:16.730093+0000","last_unstale":"2026-02-13T08:12:35.878375+0000","last_undegraded":"2026-02-13T08:12:35.878375+0000","last_fullsized":"2026-02-13T08:12:35.878375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:48:15.958288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.443979+0000","last_change":"2026-02-13T08:06:16.727401+0000","last_active":"2026-02-13T08:12:35.443979+0000","last_peered":"2026-02-13T08:12:35.443979+0000","last_clean":"2026-02-13T08:12:35.443979+0000","last_became_active":"2026-02-13T08:06:16.716681+0000","last_became_peered":"2026-02-13T08:06:16.716681+0000","last_unstale":"2026-02-13T08:12:35.443979+0000","last_undegraded":"2026-02-13T08:12:35.443979+0000","last_fullsized":"2026-02-13T08:12:35.443979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:10:02.613952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885855+0000","last_change":"2026-02-13T08:05:48.689722+0000","last_active":"2026-02-13T08:12:35.885855+0000","last_peered":"2026-02-13T08:12:35.885855+0000","last_clean":"2026-02-13T08:12:35.885855+0000","last_became_active":"2026-02-13T08:05:46.332518+0000","last_became_peered":"2026-02-13T08:05:46.332518+0000","last_unstale":"2026-02-13T08:12:35.885855+0000","last_undegraded":"2026-02-13T08:12:35.885855+0000","last_fullsized":"2026-02-13T08:12:35.885855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:47.031472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027820299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878588+0000","last_change":"2026-02-13T08:06:16.713035+0000","last_active":"2026-02-13T08:12:35.878588+0000","last_peered":"2026-02-13T08:12:35.878588+0000","last_clean":"2026-02-13T08:12:35.878588+0000","last_became_active":"2026-02-13T08:06:16.697543+0000","last_became_peered":"2026-02-13T08:06:16.697543+0000","last_unstale":"2026-02-13T08:12:35.878588+0000","last_undegraded":"2026-02-13T08:12:35.878588+0000","last_fullsized":"2026-02-13T08:12:35.878588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:09:18.778241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878644+0000","last_change":"2026-02-13T08:05:48.241308+0000","last_active":"2026-02-13T08:12:35.878644+0000","last_peered":"2026-02-13T08:12:35.878644+0000","last_clean":"2026-02-13T08:12:35.878644+0000","last_became_active":"2026-02-13T08:05:46.238040+0000","last_became_peered":"2026-02-13T08:05:46.238040+0000","last_unstale":"2026-02-13T08:12:35.878644+0000","last_undegraded":"2026-02-13T08:12:35.878644+0000","last_fullsized":"2026-02-13T08:12:35.878644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:05.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040397499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885278+0000","last_change":"2026-02-13T08:06:16.788039+0000","last_active":"2026-02-13T08:12:35.885278+0000","last_peered":"2026-02-13T08:12:35.885278+0000","last_clean":"2026-02-13T08:12:35.885278+0000","last_became_active":"2026-02-13T08:06:16.787708+0000","last_became_peered":"2026-02-13T08:06:16.787708+0000","last_unstale":"2026-02-13T08:12:35.885278+0000","last_undegraded":"2026-02-13T08:12:35.885278+0000","last_fullsized":"2026-02-13T08:12:35.885278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:31:47.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885787+0000","last_change":"2026-02-13T08:05:48.689720+0000","last_active":"2026-02-13T08:12:35.885787+0000","last_peered":"2026-02-13T08:12:35.885787+0000","last_clean":"2026-02-13T08:12:35.885787+0000","last_became_active":"2026-02-13T08:05:46.419763+0000","last_became_peered":"2026-02-13T08:05:46.419763+0000","last_unstale":"2026-02-13T08:12:35.885787+0000","last_undegraded":"2026-02-13T08:12:35.885787+0000","last_fullsized":"2026-02-13T08:12:35.885787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:11.120130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031193600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"21'11","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451420+0000","last_change":"2026-02-13T08:06:16.765198+0000","last_active":"2026-02-13T08:12:35.451420+0000","last_peered":"2026-02-13T08:12:35.451420+0000","last_clean":"2026-02-13T08:12:35.451420+0000","last_became_active":"2026-02-13T08:06:16.764436+0000","last_became_peered":"2026-02-13T08:06:16.764436+0000","last_unstale":"2026-02-13T08:12:35.451420+0000","last_undegraded":"2026-02-13T08:12:35.451420+0000","last_fullsized":"2026-02-13T08:12:35.451420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:02.239330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878381+0000","last_change":"2026-02-13T08:05:48.241321+0000","last_active":"2026-02-13T08:12:35.878381+0000","last_peered":"2026-02-13T08:12:35.878381+0000","last_clean":"2026-02-13T08:12:35.878381+0000","last_became_active":"2026-02-13T08:05:46.325615+0000","last_became_peered":"2026-02-13T08:05:46.325615+0000","last_unstale":"2026-02-13T08:12:35.878381+0000","last_undegraded":"2026-02-13T08:12:35.878381+0000","last_fullsized":"2026-02-13T08:12:35.878381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:50:27.013203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041541599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885921+0000","last_change":"2026-02-13T08:06:16.770640+0000","last_active":"2026-02-13T08:12:35.885921+0000","last_peered":"2026-02-13T08:12:35.885921+0000","last_clean":"2026-02-13T08:12:35.885921+0000","last_became_active":"2026-02-13T08:06:16.755402+0000","last_became_peered":"2026-02-13T08:06:16.755402+0000","last_unstale":"2026-02-13T08:12:35.885921+0000","last_undegraded":"2026-02-13T08:12:35.885921+0000","last_fullsized":"2026-02-13T08:12:35.885921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:28:57.063487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885388+0000","last_change":"2026-02-13T08:05:48.335785+0000","last_active":"2026-02-13T08:12:35.885388+0000","last_peered":"2026-02-13T08:12:35.885388+0000","last_clean":"2026-02-13T08:12:35.885388+0000","last_became_active":"2026-02-13T08:05:46.332174+0000","last_became_peered":"2026-02-13T08:05:46.332174+0000","last_unstale":"2026-02-13T08:12:35.885388+0000","last_undegraded":"2026-02-13T08:12:35.885388+0000","last_fullsized":"2026-02-13T08:12:35.885388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:06.536002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000284605,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878462+0000","last_change":"2026-02-13T08:06:16.678986+0000","last_active":"2026-02-13T08:12:35.878462+0000","last_peered":"2026-02-13T08:12:35.878462+0000","last_clean":"2026-02-13T08:12:35.878462+0000","last_became_active":"2026-02-13T08:06:16.674970+0000","last_became_peered":"2026-02-13T08:06:16.674970+0000","last_unstale":"2026-02-13T08:12:35.878462+0000","last_undegraded":"2026-02-13T08:12:35.878462+0000","last_fullsized":"2026-02-13T08:12:35.878462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:00:29.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.443966+0000","last_change":"2026-02-13T08:05:48.241731+0000","last_active":"2026-02-13T08:12:35.443966+0000","last_peered":"2026-02-13T08:12:35.443966+0000","last_clean":"2026-02-13T08:12:35.443966+0000","last_became_active":"2026-02-13T08:05:46.236660+0000","last_became_peered":"2026-02-13T08:05:46.236660+0000","last_unstale":"2026-02-13T08:12:35.443966+0000","last_undegraded":"2026-02-13T08:12:35.443966+0000","last_fullsized":"2026-02-13T08:12:35.443966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:54:09.509002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024995099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451485+0000","last_change":"2026-02-13T08:06:16.777794+0000","last_active":"2026-02-13T08:12:35.451485+0000","last_peered":"2026-02-13T08:12:35.451485+0000","last_clean":"2026-02-13T08:12:35.451485+0000","last_became_active":"2026-02-13T08:06:16.775702+0000","last_became_peered":"2026-02-13T08:06:16.775702+0000","last_unstale":"2026-02-13T08:12:35.451485+0000","last_undegraded":"2026-02-13T08:12:35.451485+0000","last_fullsized":"2026-02-13T08:12:35.451485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:43:38.287112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":632,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885536+0000","last_change":"2026-02-13T08:05:48.689871+0000","last_active":"2026-02-13T08:12:35.885536+0000","last_peered":"2026-02-13T08:12:35.885536+0000","last_clean":"2026-02-13T08:12:35.885536+0000","last_became_active":"2026-02-13T08:05:46.331895+0000","last_became_peered":"2026-02-13T08:05:46.331895+0000","last_unstale":"2026-02-13T08:12:35.885536+0000","last_undegraded":"2026-02-13T08:12:35.885536+0000","last_fullsized":"2026-02-13T08:12:35.885536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:19.373004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878646+0000","last_change":"2026-02-13T08:06:16.686960+0000","last_active":"2026-02-13T08:12:35.878646+0000","last_peered":"2026-02-13T08:12:35.878646+0000","last_clean":"2026-02-13T08:12:35.878646+0000","last_became_active":"2026-02-13T08:06:16.677657+0000","last_became_peered":"2026-02-13T08:06:16.677657+0000","last_unstale":"2026-02-13T08:12:35.878646+0000","last_undegraded":"2026-02-13T08:12:35.878646+0000","last_fullsized":"2026-02-13T08:12:35.878646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:26:32.313932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":622,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885416+0000","last_change":"2026-02-13T08:05:48.335814+0000","last_active":"2026-02-13T08:12:35.885416+0000","last_peered":"2026-02-13T08:12:35.885416+0000","last_clean":"2026-02-13T08:12:35.885416+0000","last_became_active":"2026-02-13T08:05:46.331985+0000","last_became_peered":"2026-02-13T08:05:46.331985+0000","last_unstale":"2026-02-13T08:12:35.885416+0000","last_undegraded":"2026-02-13T08:12:35.885416+0000","last_fullsized":"2026-02-13T08:12:35.885416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:31:52.202154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030744700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":770,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885589+0000","last_change":"2026-02-13T08:05:43.034445+0000","last_active":"2026-02-13T08:12:35.885589+0000","last_peered":"2026-02-13T08:12:35.885589+0000","last_clean":"2026-02-13T08:12:35.885589+0000","last_became_active":"2026-02-13T08:05:43.032364+0000","last_became_peered":"2026-02-13T08:05:43.032364+0000","last_unstale":"2026-02-13T08:12:35.885589+0000","last_undegraded":"2026-02-13T08:12:35.885589+0000","last_fullsized":"2026-02-13T08:12:35.885589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_clean_scrub_stamp":"2026-02-13T08:05:41.931597+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:28.101837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885801+0000","last_change":"2026-02-13T08:06:16.776465+0000","last_active":"2026-02-13T08:12:35.885801+0000","last_peered":"2026-02-13T08:12:35.885801+0000","last_clean":"2026-02-13T08:12:35.885801+0000","last_became_active":"2026-02-13T08:06:16.772994+0000","last_became_peered":"2026-02-13T08:06:16.772994+0000","last_unstale":"2026-02-13T08:12:35.885801+0000","last_undegraded":"2026-02-13T08:12:35.885801+0000","last_fullsized":"2026-02-13T08:12:35.885801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:04:01.057076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451558+0000","last_change":"2026-02-13T08:06:16.786867+0000","last_active":"2026-02-13T08:12:35.451558+0000","last_peered":"2026-02-13T08:12:35.451558+0000","last_clean":"2026-02-13T08:12:35.451558+0000","last_became_active":"2026-02-13T08:06:16.784923+0000","last_became_peered":"2026-02-13T08:06:16.784923+0000","last_unstale":"2026-02-13T08:12:35.451558+0000","last_undegraded":"2026-02-13T08:12:35.451558+0000","last_fullsized":"2026-02-13T08:12:35.451558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:50:06.043735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444144+0000","last_change":"2026-02-13T08:06:16.707306+0000","last_active":"2026-02-13T08:12:35.444144+0000","last_peered":"2026-02-13T08:12:35.444144+0000","last_clean":"2026-02-13T08:12:35.444144+0000","last_became_active":"2026-02-13T08:06:16.693128+0000","last_became_peered":"2026-02-13T08:06:16.693128+0000","last_unstale":"2026-02-13T08:12:35.444144+0000","last_undegraded":"2026-02-13T08:12:35.444144+0000","last_fullsized":"2026-02-13T08:12:35.444144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:54.479190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878673+0000","last_change":"2026-02-13T08:06:16.707698+0000","last_active":"2026-02-13T08:12:35.878673+0000","last_peered":"2026-02-13T08:12:35.878673+0000","last_clean":"2026-02-13T08:12:35.878673+0000","last_became_active":"2026-02-13T08:06:16.706496+0000","last_became_peered":"2026-02-13T08:06:16.706496+0000","last_unstale":"2026-02-13T08:12:35.878673+0000","last_undegraded":"2026-02-13T08:12:35.878673+0000","last_fullsized":"2026-02-13T08:12:35.878673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:51:56.806272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444046+0000","last_change":"2026-02-13T08:06:16.715614+0000","last_active":"2026-02-13T08:12:35.444046+0000","last_peered":"2026-02-13T08:12:35.444046+0000","last_clean":"2026-02-13T08:12:35.444046+0000","last_became_active":"2026-02-13T08:06:16.704582+0000","last_became_peered":"2026-02-13T08:06:16.704582+0000","last_unstale":"2026-02-13T08:12:35.444046+0000","last_undegraded":"2026-02-13T08:12:35.444046+0000","last_fullsized":"2026-02-13T08:12:35.444046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:44:44.321422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878343+0000","last_change":"2026-02-13T08:06:16.704281+0000","last_active":"2026-02-13T08:12:35.878343+0000","last_peered":"2026-02-13T08:12:35.878343+0000","last_clean":"2026-02-13T08:12:35.878343+0000","last_became_active":"2026-02-13T08:06:16.703565+0000","last_became_peered":"2026-02-13T08:06:16.703565+0000","last_unstale":"2026-02-13T08:12:35.878343+0000","last_undegraded":"2026-02-13T08:12:35.878343+0000","last_fullsized":"2026-02-13T08:12:35.878343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:23:50.778453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444069+0000","last_change":"2026-02-13T08:06:16.723599+0000","last_active":"2026-02-13T08:12:35.444069+0000","last_peered":"2026-02-13T08:12:35.444069+0000","last_clean":"2026-02-13T08:12:35.444069+0000","last_became_active":"2026-02-13T08:06:16.714959+0000","last_became_peered":"2026-02-13T08:06:16.714959+0000","last_unstale":"2026-02-13T08:12:35.444069+0000","last_undegraded":"2026-02-13T08:12:35.444069+0000","last_fullsized":"2026-02-13T08:12:35.444069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:40:57.442734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878397+0000","last_change":"2026-02-13T08:06:16.712337+0000","last_active":"2026-02-13T08:12:35.878397+0000","last_peered":"2026-02-13T08:12:35.878397+0000","last_clean":"2026-02-13T08:12:35.878397+0000","last_became_active":"2026-02-13T08:06:16.706451+0000","last_became_peered":"2026-02-13T08:06:16.706451+0000","last_unstale":"2026-02-13T08:12:35.878397+0000","last_undegraded":"2026-02-13T08:12:35.878397+0000","last_fullsized":"2026-02-13T08:12:35.878397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:52:30.382122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878472+0000","last_change":"2026-02-13T08:06:16.741236+0000","last_active":"2026-02-13T08:12:35.878472+0000","last_peered":"2026-02-13T08:12:35.878472+0000","last_clean":"2026-02-13T08:12:35.878472+0000","last_became_active":"2026-02-13T08:06:16.737141+0000","last_became_peered":"2026-02-13T08:06:16.737141+0000","last_unstale":"2026-02-13T08:12:35.878472+0000","last_undegraded":"2026-02-13T08:12:35.878472+0000","last_fullsized":"2026-02-13T08:12:35.878472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:44:46.098224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885849+0000","last_change":"2026-02-13T08:06:16.794002+0000","last_active":"2026-02-13T08:12:35.885849+0000","last_peered":"2026-02-13T08:12:35.885849+0000","last_clean":"2026-02-13T08:12:35.885849+0000","last_became_active":"2026-02-13T08:06:16.791964+0000","last_became_peered":"2026-02-13T08:06:16.791964+0000","last_unstale":"2026-02-13T08:12:35.885849+0000","last_undegraded":"2026-02-13T08:12:35.885849+0000","last_fullsized":"2026-02-13T08:12:35.885849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:37.844323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451518+0000","last_change":"2026-02-13T08:06:16.765157+0000","last_active":"2026-02-13T08:12:35.451518+0000","last_peered":"2026-02-13T08:12:35.451518+0000","last_clean":"2026-02-13T08:12:35.451518+0000","last_became_active":"2026-02-13T08:06:16.764042+0000","last_became_peered":"2026-02-13T08:06:16.764042+0000","last_unstale":"2026-02-13T08:12:35.451518+0000","last_undegraded":"2026-02-13T08:12:35.451518+0000","last_fullsized":"2026-02-13T08:12:35.451518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:28:31.364151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885649+0000","last_change":"2026-02-13T08:06:16.799617+0000","last_active":"2026-02-13T08:12:35.885649+0000","last_peered":"2026-02-13T08:12:35.885649+0000","last_clean":"2026-02-13T08:12:35.885649+0000","last_became_active":"2026-02-13T08:06:16.799194+0000","last_became_peered":"2026-02-13T08:06:16.799194+0000","last_unstale":"2026-02-13T08:12:35.885649+0000","last_undegraded":"2026-02-13T08:12:35.885649+0000","last_fullsized":"2026-02-13T08:12:35.885649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:43:24.016414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":1180736,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640357,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":4613,"kb_used_meta":58426,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409441,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":4724473,"internal_metadata":59828487},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640357,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":3011,"kb_used_meta":60028,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409427,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":3083702,"internal_metadata":61469258},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640357,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66756,"kb_used_data":3700,"kb_used_omap":3015,"kb_used_meta":60024,"kb_avail":94305084,"statfs":{"total":96636764160,"available":96568406016,"internally_reserved":0,"allocated":3788800,"data_stored":2999790,"data_compressed":663918,"data_compressed_allocated":1351680,"data_compressed_original":2514840,"omap_allocated":3088323,"internal_metadata":61464637},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640357,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66708,"kb_used_data":3652,"kb_used_omap":2924,"kb_used_meta":60115,"kb_avail":94305132,"statfs":{"total":96636764160,"available":96568455168,"internally_reserved":0,"allocated":3739648,"data_stored":2409422,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":2994630,"internal_metadata":61558330},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640358,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":5013,"kb_used_meta":58026,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409441,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":5134330,"internal_metadata":59418630},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640357,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66760,"kb_used_data":3704,"kb_used_omap":2523,"kb_used_meta":60516,"kb_avail":94305080,"statfs":{"total":96636764160,"available":96568401920,"internally_reserved":0,"allocated":3792896,"data_stored":2999795,"data_compressed":663918,"data_compressed_allocated":1351680,"data_compressed_original":2514840,"omap_allocated":2583910,"internal_metadata":61969050},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T08:14:03.289 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-13T08:14:03.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 10 monclient: get_monmap_and_config 2026-02-13T08:14:03.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 10 monclient: build_initial_monmap 2026-02-13T08:14:03.358 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 10 monclient: monmap: 2026-02-13T08:14:03.358 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:03.358 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.359 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:03.355009+0000 2026-02-13T08:14:03.359 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:03.355009+0000 2026-02-13T08:14:03.359 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:03.359 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.359 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:03.359 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:03.359 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:03.359 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.366 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 1 Processor -- start 2026-02-13T08:14:03.366 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 1 -- start start 2026-02-13T08:14:03.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 10 monclient: init 2026-02-13T08:14:03.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:03.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:03.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 10 monclient(hunting): picked mon.noname-c con 0x7fdc84057e80 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:03.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 10 monclient(hunting): picked mon.noname-b con 0x7fdc8408c8e0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:03.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 10 monclient(hunting): picked mon.noname-a con 0x7fdc8408ccb0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:03.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8408f0f0 con 0x7fdc8408ccb0 2026-02-13T08:14:03.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8408de80 con 0x7fdc84057e80 2026-02-13T08:14:03.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8408d0c0 con 0x7fdc8408c8e0 2026-02-13T08:14:03.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:03.367 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc89f88640 10 monclient(hunting): authenticate will time out at 948.943693s 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc82ffd640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fdc8408c8e0 0x7fdc84180960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57724/0 (socket says 10.20.193.104:57724) 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc82ffd640 1 -- 10.20.193.104:0/1879422016 learned_addr learned my addr 10.20.193.104:0/1879422016 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc83fff640 1 --1- 10.20.193.104:0/1879422016 >> v1:10.20.193.104:6789/0 conn(0x7fdc8408ccb0 0x7fdc841a2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44986/0 (socket says 10.20.193.104:44986) 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc827fc640 1 -- 10.20.193.104:0/1879422016 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453465965 0 0) 0x7fdc8408d0c0 con 0x7fdc8408c8e0 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc827fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc827fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc827fc640 10 monclient(hunting): my global_id is 104159 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc827fc640 1 -- 10.20.193.104:0/1879422016 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc68003620 con 0x7fdc8408c8e0 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.348+0000 7fdc827fc640 1 -- 10.20.193.104:0/1879422016 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915550649 0 0) 0x7fdc78002bd0 con 0x7fdc8408ccb0 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.368 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient(hunting): my global_id is 94248 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 1 -- 10.20.193.104:0/1879422016 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc8408d0c0 con 0x7fdc8408ccb0 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 1 -- 10.20.193.104:0/1879422016 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 325837611 0 0) 0x7fdc68003620 con 0x7fdc8408c8e0 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 1 -- 10.20.193.104:0/1879422016 >> v1:10.20.193.119:6789/0 conn(0x7fdc84057e80 legacy=0x7fdc8408c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 1 -- 10.20.193.104:0/1879422016 >> v1:10.20.193.104:6789/0 conn(0x7fdc8408ccb0 legacy=0x7fdc841a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient: _finish_hunting 0 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 1 monclient: found mon.noname-b 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 1 -- 10.20.193.104:0/1879422016 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc84058250 con 0x7fdc8408c8e0 2026-02-13T08:14:03.369 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient: _finish_auth 0 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient: _check_auth_tickets 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 1 -- 10.20.193.104:0/1879422016 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc74002e00 con 0x7fdc8408c8e0 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient: dump: 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.370 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 5 monclient: authenticate success, global_id 104159 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 1 -- 10.20.193.104:0/1879422016 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc74003040 con 0x7fdc8408c8e0 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 1 -- 10.20.193.104:0/1879422016 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc74003480 con 0x7fdc8408c8e0 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc827fc640 10 monclient: dump: 2026-02-13T08:14:03.371 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 4 set_mon_vals no callback set 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: shutdown 2026-02-13T08:14:03.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- 10.20.193.104:0/1879422016 >> v1:10.20.193.104:6790/0 conn(0x7fdc8408c8e0 legacy=0x7fdc84180960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- 10.20.193.104:0/1879422016 shutdown_connections 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- 10.20.193.104:0/1879422016 >> 10.20.193.104:0/1879422016 conn(0x7fdc8408e2d0 msgr2=0x7fdc8408e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- 10.20.193.104:0/1879422016 shutdown_connections 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- 10.20.193.104:0/1879422016 wait complete. 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: build_initial_monmap 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: monmap: 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:03.373 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 librados: starting msgr at 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 librados: starting objecter 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 Processor -- start 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- start start 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 librados: setting wanted keys 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 librados: calling monclient init 2026-02-13T08:14:03.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: init 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient(hunting): picked mon.noname-b con 0x7fdc84057e80 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient(hunting): picked mon.noname-a con 0x7fdc8408c8e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient(hunting): picked mon.noname-c con 0x7fdc8408ccb0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8405e080 con 0x7fdc8408c8e0 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc8408a0e0 con 0x7fdc84057e80 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc840889c0 con 0x7fdc8408ccb0 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient(hunting): authenticate will time out at 948.946119s 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc83fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fdc8408ccb0 0x7fdc84238d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57732/0 (socket says 10.20.193.104:57732) 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc83fff640 1 -- 10.20.193.104:0/3068557108 learned_addr learned my addr 10.20.193.104:0/3068557108 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:03.375 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc82ffd640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fdc8408c8e0 0x7fdc84217650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44990/0 (socket says 10.20.193.104:44990) 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 client.?.objecter ms_handle_connect 0x7fdc8408ccb0 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 client.?.objecter ms_handle_connect 0x7fdc8408c8e0 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3289713813 0 0) 0x7fdc840889c0 con 0x7fdc8408ccb0 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): my global_id is 104162 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc54003620 con 0x7fdc8408ccb0 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2716623030 0 0) 0x7fdc8405e080 con 0x7fdc8408c8e0 2026-02-13T08:14:03.376 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): my global_id is 94251 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc840889c0 con 0x7fdc8408c8e0 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 543149719 0 0) 0x7fdc840889c0 con 0x7fdc8408c8e0 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc8405e080 con 0x7fdc8408c8e0 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2333762686 0 0) 0x7fdc54003620 con 0x7fdc8408ccb0 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc840889c0 con 0x7fdc8408ccb0 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc740031f0 con 0x7fdc8408c8e0 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): dump: 2026-02-13T08:14:03.377 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc780034b0 con 0x7fdc8408ccb0 2026-02-13T08:14:03.378 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient(hunting): dump: 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.379 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4106988821 0 0) 0x7fdc8405e080 con 0x7fdc8408c8e0 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 >> v1:10.20.193.104:6790/0 conn(0x7fdc8408ccb0 legacy=0x7fdc84238d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 >> v1:10.20.193.119:6789/0 conn(0x7fdc84057e80 legacy=0x7fdc841a2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient: _finish_hunting 0 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 monclient: found mon.a 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc841a0630 con 0x7fdc8408c8e0 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient: _finish_auth 0 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient: _check_auth_tickets 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 5 monclient: authenticate success, global_id 94251 2026-02-13T08:14:03.380 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: _renew_subs 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- 10.20.193.104:0/3068557108 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdc8419fdf0 con 0x7fdc8408c8e0 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 client.94251.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: _renew_subs 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- 10.20.193.104:0/3068557108 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdc841a3180 con 0x7fdc8408c8e0 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 librados: init done 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc74003510 con 0x7fdc8408c8e0 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdc74004e90 con 0x7fdc8408c8e0 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:03.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc81ffb640 4 set_mon_vals no callback set 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 monclient: dump: 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:03.382 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc89f88640 1 -- 10.20.193.104:0/3068557108 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc84061860 con 0x7fdc8408c8e0 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fdc74010ea0 con 0x7fdc8408c8e0 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7fdc7404a490 con 0x7fdc8408c8e0 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 client.94251.objecter ms_dispatch2 0x7fdc84000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 3 client.94251.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 3 client.94251.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 20 client.94251.objecter dump_active .. 0 homeless 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc837fe640 10 monclient: get_auth_request con 0x7fdc5403b970 auth_method 0 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.352+0000 7fdc5ffff640 10 client.94251.objecter ms_handle_connect 0x7fdc5403b970 2026-02-13T08:14:03.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.356+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7fdc8419fdf0 con 0x7fdc8408c8e0 2026-02-13T08:14:03.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.356+0000 7fdc5ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:03.384 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.356+0000 7fdc5ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:03.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:14:03.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:14:03.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:03.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 1 -- 10.20.193.104:0/3068557108 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdc8405d820 con 0x7fdc8408c8e0 2026-02-13T08:14:03.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc5ffff640 1 -- 10.20.193.104:0/3068557108 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v323) ==== 74+0+13536 (unknown 952665033 0 3199315829) 0x7fdc74016bb0 con 0x7fdc8408c8e0 2026-02-13T08:14:03.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc5ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-13T08:14:03.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc5ffff640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:14:03.450 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:14:03.451 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":323,"fsid":"0e1d0140-145d-4ea8-a799-1ca564383c2b","created":"2026-02-13T08:05:35.908543+0000","modified":"2026-02-13T08:12:35.441493+0000","last_up_change":"2026-02-13T08:05:40.923658+0000","last_in_change":"2026-02-13T08:05:36.956118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":95,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":268,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T08:05:41.903600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-13T08:05:44.705774+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"ceph_test_rados_api_asio","create_time":"2026-02-13T08:06:14.672005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"460b851b-aaa4-48d1-a60f-7c4d57195f60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":320,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6808","nonce":1354850314}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6809","nonce":1354850314}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6811","nonce":1354850314}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6810","nonce":1354850314}]},"public_addr":"10.20.193.104:6808/1354850314","cluster_addr":"10.20.193.104:6809/1354850314","heartbeat_back_addr":"10.20.193.104:6811/1354850314","heartbeat_front_addr":"10.20.193.104:6810/1354850314","state":["exists","up"]},{"osd":1,"uuid":"b96ae2ae-1756-45e7-932c-2e09b469bbf2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":320,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6804","nonce":3474406264}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6805","nonce":3474406264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6807","nonce":3474406264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6806","nonce":3474406264}]},"public_addr":"10.20.193.104:6804/3474406264","cluster_addr":"10.20.193.104:6805/3474406264","heartbeat_back_addr":"10.20.193.104:6807/3474406264","heartbeat_front_addr":"10.20.193.104:6806/3474406264","state":["exists","up"]},{"osd":2,"uuid":"1ae934c3-1aba-4596-abae-1b7697ebf029","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":320,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6800","nonce":3938786817}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6801","nonce":3938786817}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6803","nonce":3938786817}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.104:6802","nonce":3938786817}]},"public_addr":"10.20.193.104:6800/3938786817","cluster_addr":"10.20.193.104:6801/3938786817","heartbeat_back_addr":"10.20.193.104:6803/3938786817","heartbeat_front_addr":"10.20.193.104:6802/3938786817","state":["exists","up"]},{"osd":3,"uuid":"029c49a7-88e6-439c-90f8-534c1b8e4056","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":320,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6800","nonce":4283496532}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6801","nonce":4283496532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6803","nonce":4283496532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6802","nonce":4283496532}]},"public_addr":"10.20.193.119:6800/4283496532","cluster_addr":"10.20.193.119:6801/4283496532","heartbeat_back_addr":"10.20.193.119:6803/4283496532","heartbeat_front_addr":"10.20.193.119:6802/4283496532","state":["exists","up"]},{"osd":4,"uuid":"a8122973-739c-4b4b-a9f5-59eac5f15f79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":320,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6808","nonce":1543069880}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6809","nonce":1543069880}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6811","nonce":1543069880}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6810","nonce":1543069880}]},"public_addr":"10.20.193.119:6808/1543069880","cluster_addr":"10.20.193.119:6809/1543069880","heartbeat_back_addr":"10.20.193.119:6811/1543069880","heartbeat_front_addr":"10.20.193.119:6810/1543069880","state":["exists","up"]},{"osd":5,"uuid":"8901cba8-49ff-4a2a-8f16-6b3db8eff80e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":320,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6804","nonce":527707922}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6805","nonce":527707922}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6807","nonce":527707922}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"10.20.193.119:6806","nonce":527707922}]},"public_addr":"10.20.193.119:6804/527707922","cluster_addr":"10.20.193.119:6805/527707922","heartbeat_back_addr":"10.20.193.119:6807/527707922","heartbeat_front_addr":"10.20.193.119:6806/527707922","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T08:05:39.681266+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T08:05:39.653035+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T08:05:39.517565+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T08:05:39.832728+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T08:05:39.772988+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T08:05:39.853864+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":13,"snaps":[{"begin":1,"length":4}]},{"pool":14,"snaps":[{"begin":3,"length":4}]},{"pool":32,"snaps":[{"begin":1,"length":1}]},{"pool":61,"snaps":[{"begin":1,"length":1}]},{"pool":90,"snaps":[{"begin":4,"length":2},{"begin":7,"length":2}]},{"pool":100,"snaps":[{"begin":1,"length":1}]},{"pool":120,"snaps":[{"begin":1,"length":2}]},{"pool":135,"snaps":[{"begin":3,"length":1}]},{"pool":142,"snaps":[{"begin":1,"length":4}]},{"pool":148,"snaps":[{"begin":2,"length":2}]},{"pool":158,"snaps":[{"begin":2,"length":3}]},{"pool":167,"snaps":[{"begin":2,"length":4}]},{"pool":168,"snaps":[{"begin":2,"length":2}]},{"pool":179,"snaps":[{"begin":2,"length":1}]},{"pool":184,"snaps":[{"begin":2,"length":3}]},{"pool":197,"snaps":[{"begin":4,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T08:14:03.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 10 librados: watch_flush enter 2026-02-13T08:14:03.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 10 librados: watch_flush exit 2026-02-13T08:14:03.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 20 client.94251.objecter shutdown clearing up homeless session... 2026-02-13T08:14:03.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 10 client.94251.objecter successfully canceled tick 2026-02-13T08:14:03.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 1 -- 10.20.193.104:0/3068557108 >> v1:10.20.193.119:6812/276487904 conn(0x7fdc5403b970 legacy=0x7fdc5405be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 10 monclient: shutdown 2026-02-13T08:14:03.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:03.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 1 -- 10.20.193.104:0/3068557108 >> v1:10.20.193.104:6789/0 conn(0x7fdc8408c8e0 legacy=0x7fdc84217650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:03.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 1 -- 10.20.193.104:0/3068557108 shutdown_connections 2026-02-13T08:14:03.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 1 -- 10.20.193.104:0/3068557108 >> 10.20.193.104:0/3068557108 conn(0x7fdc8408e2d0 msgr2=0x7fdc84085680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:03.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 1 -- 10.20.193.104:0/3068557108 shutdown_connections 2026-02-13T08:14:03.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 1 -- 10.20.193.104:0/3068557108 wait complete. 2026-02-13T08:14:03.453 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:03.440+0000 7fdc89f88640 1 librados: shutdown 2026-02-13T08:14:04.461 INFO:tasks.ceph:Scrubbing osd.0 2026-02-13T08:14:04.462 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-13T08:14:04.535 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.524+0000 7fb81924e640 10 monclient: get_monmap_and_config 2026-02-13T08:14:04.535 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.524+0000 7fb81924e640 10 monclient: build_initial_monmap 2026-02-13T08:14:04.536 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.524+0000 7fb81924e640 10 monclient: monmap: 2026-02-13T08:14:04.536 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:04.536 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.536 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:04.531697+0000 2026-02-13T08:14:04.536 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:04.531697+0000 2026-02-13T08:14:04.536 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:04.536 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.536 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:04.536 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:04.536 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:04.536 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.537 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 Processor -- start 2026-02-13T08:14:04.537 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- start start 2026-02-13T08:14:04.537 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: init 2026-02-13T08:14:04.546 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:04.546 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:14:04.546 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient(hunting): picked mon.noname-c con 0x7fb814089270 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:04.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient(hunting): picked mon.noname-a con 0x7fb814089640 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:04.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient(hunting): picked mon.noname-b con 0x7fb81417efa0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:04.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81408b760 con 0x7fb814089640 2026-02-13T08:14:04.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81408abe0 con 0x7fb814089270 2026-02-13T08:14:04.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb81413c170 con 0x7fb81417efa0 2026-02-13T08:14:04.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:04.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient(hunting): authenticate will time out at 950.120626s 2026-02-13T08:14:04.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb812575640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fb814089640 0x7fb81408a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44998/0 (socket says 10.20.193.104:44998) 2026-02-13T08:14:04.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb812575640 1 -- 10.20.193.104:0/2621897128 learned_addr learned my addr 10.20.193.104:0/2621897128 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:04.547 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb813577640 1 --1- 10.20.193.104:0/2621897128 >> v1:10.20.193.104:6790/0 conn(0x7fb81417efa0 0x7fb81419f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57734/0 (socket says 10.20.193.104:57734) 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 -- 10.20.193.104:0/2621897128 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2369776038 0 0) 0x7fb81408b760 con 0x7fb814089640 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient(hunting): my global_id is 94254 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 -- 10.20.193.104:0/2621897128 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb800003620 con 0x7fb814089640 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 -- 10.20.193.104:0/2621897128 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1460112604 0 0) 0x7fb81413c170 con 0x7fb81417efa0 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient(hunting): my global_id is 104165 2026-02-13T08:14:04.548 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 -- 10.20.193.104:0/2621897128 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb81408b760 con 0x7fb81417efa0 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 -- 10.20.193.104:0/2621897128 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1643783657 0 0) 0x7fb800003620 con 0x7fb814089640 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 -- 10.20.193.104:0/2621897128 >> v1:10.20.193.104:6790/0 conn(0x7fb81417efa0 legacy=0x7fb81419f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 -- 10.20.193.104:0/2621897128 >> v1:10.20.193.119:6789/0 conn(0x7fb814089270 legacy=0x7fb814089dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient: _finish_hunting 0 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 monclient: found mon.noname-a 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 -- 10.20.193.104:0/2621897128 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb814087080 con 0x7fb814089640 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient: _finish_auth 0 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient: _check_auth_tickets 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:04.549 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 -- 10.20.193.104:0/2621897128 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb7fc002e00 con 0x7fb814089640 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient: dump: 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.550 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 5 monclient: authenticate success, global_id 94254 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 -- 10.20.193.104:0/2621897128 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7fc002fd0 con 0x7fb814089640 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 1 -- 10.20.193.104:0/2621897128 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb7fc003410 con 0x7fb814089640 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811d74640 10 monclient: dump: 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.551 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 4 set_mon_vals no callback set 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: shutdown 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- 10.20.193.104:0/2621897128 >> v1:10.20.193.104:6789/0 conn(0x7fb814089640 legacy=0x7fb81408a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.552 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- 10.20.193.104:0/2621897128 shutdown_connections 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- 10.20.193.104:0/2621897128 >> 10.20.193.104:0/2621897128 conn(0x7fb81408d6c0 msgr2=0x7fb81408dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- 10.20.193.104:0/2621897128 shutdown_connections 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- 10.20.193.104:0/2621897128 wait complete. 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: build_initial_monmap 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: monmap: 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.553 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 librados: starting msgr at 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 librados: starting objecter 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 Processor -- start 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- start start 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 librados: setting wanted keys 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 librados: calling monclient init 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: init 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:04.554 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient(hunting): picked mon.noname-c con 0x7fb814089270 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient(hunting): picked mon.noname-a con 0x7fb814089640 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient(hunting): picked mon.noname-b con 0x7fb81417efa0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb814052240 con 0x7fb814089640 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb814057fe0 con 0x7fb81417efa0 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8140865b0 con 0x7fb814089270 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient(hunting): authenticate will time out at 950.123112s 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb812d76640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fb814089270 0x7fb81413b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57742/0 (socket says 10.20.193.104:57742) 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb812d76640 1 -- 10.20.193.104:0/3550781822 learned_addr learned my addr 10.20.193.104:0/3550781822 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 client.?.objecter ms_handle_connect 0x7fb814089270 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:04.555 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 client.?.objecter ms_handle_connect 0x7fb814089640 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692294628 0 0) 0x7fb8140865b0 con 0x7fb814089270 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): my global_id is 104168 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e0003620 con 0x7fb814089270 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1619210439 0 0) 0x7fb814052240 con 0x7fb814089640 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): my global_id is 94257 2026-02-13T08:14:04.556 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8140865b0 con 0x7fb814089640 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 client.?.objecter ms_handle_connect 0x7fb81417efa0 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 140524611 0 0) 0x7fb7e0003620 con 0x7fb814089270 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb814052240 con 0x7fb814089270 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb8080031a0 con 0x7fb814089270 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): dump: 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.557 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.558 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.558 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.558 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.558 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.558 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.558 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:04.558 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2388397176 0 0) 0x7fb8140865b0 con 0x7fb814089640 2026-02-13T08:14:04.558 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7e0003620 con 0x7fb814089640 2026-02-13T08:14:04.558 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb7fc003180 con 0x7fb814089640 2026-02-13T08:14:04.558 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:04.558 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): dump: 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3625375774 0 0) 0x7fb814057fe0 con 0x7fb81417efa0 2026-02-13T08:14:04.559 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient(hunting): my global_id is 74725 2026-02-13T08:14:04.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8140865b0 con 0x7fb81417efa0 2026-02-13T08:14:04.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3390869373 0 0) 0x7fb814052240 con 0x7fb814089270 2026-02-13T08:14:04.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 >> v1:10.20.193.119:6789/0 conn(0x7fb81417efa0 legacy=0x7fb814171eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 >> v1:10.20.193.104:6789/0 conn(0x7fb814089640 legacy=0x7fb814170790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient: _finish_hunting 0 2026-02-13T08:14:04.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 monclient: found mon.c 2026-02-13T08:14:04.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:04.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81412fc60 con 0x7fb814089270 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient: _finish_auth 0 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient: _check_auth_tickets 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 5 monclient: authenticate success, global_id 104168 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: _renew_subs 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- 10.20.193.104:0/3550781822 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb81412f3c0 con 0x7fb814089270 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 client.104168.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: _renew_subs 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- 10.20.193.104:0/3550781822 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb81413b920 con 0x7fb814089270 2026-02-13T08:14:04.561 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 librados: init done 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8080039c0 con 0x7fb814089270 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fb808003d90 con 0x7fb814089270 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb7f37fe640 10 monclient: dump: 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.562 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb811573640 4 set_mon_vals no callback set 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 client.104168.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 15 client.104168.objecter _session_command_op_assign -1 1 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 20 client.104168.objecter _get_session osd=-1 returning homeless 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 client.104168.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.528+0000 7fb81924e640 1 -- 10.20.193.104:0/3550781822 --> v1:10.20.193.104:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fb81414c480 con 0x7fb814089270 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fb808003fb0 con 0x7fb814089270 2026-02-13T08:14:04.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7fb80804a720 con 0x7fb814089270 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 10 client.104168.objecter ms_dispatch2 0x7fb814000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 3 client.104168.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 3 client.104168.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 10 client.104168.objecter checking command 1 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 20 client.104168.objecter _get_session s=0x7fb7e00611c0 osd=0 3 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 20 client.104168.objecter put_session s=0x7fb7e00611c0 osd=0 3 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 15 client.104168.objecter _session_command_op_remove -1 1 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 20 client.104168.objecter _get_session s=0x7fb7e00611c0 osd=0 3 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 20 client.104168.objecter get_session s=0x7fb7e00611c0 osd=0 3 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 15 client.104168.objecter _session_command_op_assign 0 1 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 20 client.104168.objecter put_session s=0x7fb7e00611c0 osd=0 4 2026-02-13T08:14:04.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 10 client.104168.objecter _send_command 1 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 --> v1:10.20.193.104:6808/1354850314 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7e0083570 con 0x7fb7e0061870 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 20 client.104168.objecter dump_active .. 0 homeless 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_get_version_reply(handle=1 version=323) ==== 24+0+0 (unknown 3751641255 0 0) 0x7fb80804aab0 con 0x7fb814089270 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 10 monclient: handle_get_version_reply finishing 1 version 323 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb813577640 10 monclient: get_auth_request con 0x7fb7e0061870 auth_method 0 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb812575640 10 monclient: get_auth_request con 0x7fb7e003b8b0 auth_method 0 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 10 client.104168.objecter ms_handle_connect 0x7fb7e0061870 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 10 client.104168.objecter ms_handle_connect 0x7fb7e003b8b0 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== osd.0 v1:10.20.193.104:6808/1354850314 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fb7e0083570 con 0x7fb7e0061870 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 10 client.104168.objecter ms_dispatch2 0x7fb814000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 10 client.104168.objecter _finish_command 1 = system:0 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 20 client.104168.objecter put_session s=0x7fb7e00611c0 osd=0 4 2026-02-13T08:14:04.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.532+0000 7fb7f37fe640 15 client.104168.objecter _session_command_op_remove 0 1 2026-02-13T08:14:04.566 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 10 client.104168.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-13T08:14:04.566 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 15 client.104168.objecter _session_command_op_assign -1 2 2026-02-13T08:14:04.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 20 client.104168.objecter _get_session s=0x7fb7e00611c0 osd=0 3 2026-02-13T08:14:04.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 20 client.104168.objecter put_session s=0x7fb7e00611c0 osd=0 3 2026-02-13T08:14:04.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 20 client.104168.objecter _get_session s=0x7fb7e00611c0 osd=0 3 2026-02-13T08:14:04.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 15 client.104168.objecter _session_command_op_remove -1 2 2026-02-13T08:14:04.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 20 client.104168.objecter get_session s=0x7fb7e00611c0 osd=0 3 2026-02-13T08:14:04.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 15 client.104168.objecter _session_command_op_assign 0 2 2026-02-13T08:14:04.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 20 client.104168.objecter put_session s=0x7fb7e00611c0 osd=0 4 2026-02-13T08:14:04.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 10 client.104168.objecter _send_command 2 2026-02-13T08:14:04.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 1 -- 10.20.193.104:0/3550781822 --> v1:10.20.193.104:6808/1354850314 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb814051ad0 con 0x7fb7e0061870 2026-02-13T08:14:04.568 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:14:04.568 INFO:teuthology.orchestra.run.trial104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T08:14:04.568 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:14:04.569 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb7f37fe640 1 -- 10.20.193.104:0/3550781822 <== osd.0 v1:10.20.193.104:6808/1354850314 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fb814051ad0 con 0x7fb7e0061870 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb7f37fe640 10 client.104168.objecter ms_dispatch2 0x7fb814000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb7f37fe640 10 client.104168.objecter _finish_command 2 = system:0 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb7f37fe640 20 client.104168.objecter put_session s=0x7fb7e00611c0 osd=0 4 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb7f37fe640 15 client.104168.objecter _session_command_op_remove 0 2 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 10 librados: watch_flush enter 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 10 librados: watch_flush exit 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 10 client.104168.objecter close_session for osd.0 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 1 -- 10.20.193.104:0/3550781822 >> v1:10.20.193.104:6808/1354850314 conn(0x7fb7e0061870 legacy=0x7fb7e0081d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 20 client.104168.objecter put_session s=0x7fb7e00611c0 osd=0 1 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 20 client.104168.objecter shutdown clearing up homeless session... 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 10 client.104168.objecter successfully canceled tick 2026-02-13T08:14:04.570 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 1 -- 10.20.193.104:0/3550781822 >> v1:10.20.193.119:6812/276487904 conn(0x7fb7e003b8b0 legacy=0x7fb7e005bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 10 monclient: shutdown 2026-02-13T08:14:04.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:04.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 1 -- 10.20.193.104:0/3550781822 >> v1:10.20.193.104:6790/0 conn(0x7fb814089270 legacy=0x7fb81413b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb813577640 1 -- 10.20.193.104:0/3550781822 reap_dead start 2026-02-13T08:14:04.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 1 -- 10.20.193.104:0/3550781822 shutdown_connections 2026-02-13T08:14:04.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 1 -- 10.20.193.104:0/3550781822 >> 10.20.193.104:0/3550781822 conn(0x7fb81408d6c0 msgr2=0x7fb81408f350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:04.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 1 -- 10.20.193.104:0/3550781822 shutdown_connections 2026-02-13T08:14:04.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 1 -- 10.20.193.104:0/3550781822 wait complete. 2026-02-13T08:14:04.571 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.540+0000 7fb81924e640 1 librados: shutdown 2026-02-13T08:14:04.571 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-13T08:14:04.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.620+0000 7f34325f2640 10 monclient: get_monmap_and_config 2026-02-13T08:14:04.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.620+0000 7f34325f2640 10 monclient: build_initial_monmap 2026-02-13T08:14:04.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.620+0000 7f34325f2640 10 monclient: monmap: 2026-02-13T08:14:04.639 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:04.639 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.639 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:04.627518+0000 2026-02-13T08:14:04.639 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:04.627518+0000 2026-02-13T08:14:04.639 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:04.639 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.639 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:04.639 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:04.639 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:04.639 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.639 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.620+0000 7f34325f2640 1 Processor -- start 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.620+0000 7f34325f2640 1 -- start start 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.620+0000 7f34325f2640 10 monclient: init 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient(hunting): picked mon.noname-c con 0x7f342c091740 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient(hunting): picked mon.noname-a con 0x7f342c13f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient(hunting): picked mon.noname-b con 0x7f342c13fcd0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342c08e5f0 con 0x7f342c13f870 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342c08e8d0 con 0x7f342c091740 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342c08ebb0 con 0x7f342c13fcd0 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:04.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient(hunting): authenticate will time out at 950.216208s 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3430b68640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f342c13fcd0 0x7f342c1a1dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57746/0 (socket says 10.20.193.104:57746) 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342b7fe640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f342c13f870 0x7f342c180690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:45018/0 (socket says 10.20.193.104:45018) 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3430b68640 1 -- 10.20.193.104:0/463121948 learned_addr learned my addr 10.20.193.104:0/463121948 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 -- 10.20.193.104:0/463121948 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255089896 0 0) 0x7f342c08e5f0 con 0x7f342c13f870 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient(hunting): my global_id is 94260 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 -- 10.20.193.104:0/463121948 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3410003620 con 0x7f342c13f870 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 -- 10.20.193.104:0/463121948 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647413231 0 0) 0x7f342c08ebb0 con 0x7f342c13fcd0 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient(hunting): my global_id is 104171 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 -- 10.20.193.104:0/463121948 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f342c08e5f0 con 0x7f342c13fcd0 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 -- 10.20.193.104:0/463121948 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2948238590 0 0) 0x7f342c08e5f0 con 0x7f342c13fcd0 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 -- 10.20.193.104:0/463121948 >> v1:10.20.193.119:6789/0 conn(0x7f342c091740 legacy=0x7f342c13f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 -- 10.20.193.104:0/463121948 >> v1:10.20.193.104:6789/0 conn(0x7f342c13f870 legacy=0x7f342c180690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient: _finish_hunting 0 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 monclient: found mon.noname-b 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 -- 10.20.193.104:0/463121948 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342c091b10 con 0x7f342c13fcd0 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient: _finish_auth 0 2026-02-13T08:14:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient: _check_auth_tickets 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 -- 10.20.193.104:0/463121948 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3420003180 con 0x7f342c13fcd0 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient: dump: 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.643 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 5 monclient: authenticate success, global_id 104171 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 -- 10.20.193.104:0/463121948 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34200033d0 con 0x7f342c13fcd0 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 1 -- 10.20.193.104:0/463121948 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3420003810 con 0x7f342c13fcd0 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342affd640 10 monclient: dump: 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.644 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.645 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.645 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.645 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.645 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.645 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.645 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.645 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.645 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:04.645 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 4 set_mon_vals no callback set 2026-02-13T08:14:04.645 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: shutdown 2026-02-13T08:14:04.645 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- 10.20.193.104:0/463121948 >> v1:10.20.193.104:6790/0 conn(0x7f342c13fcd0 legacy=0x7f342c1a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- 10.20.193.104:0/463121948 shutdown_connections 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- 10.20.193.104:0/463121948 >> 10.20.193.104:0/463121948 conn(0x7f342c090810 msgr2=0x7f342c090c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- 10.20.193.104:0/463121948 shutdown_connections 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- 10.20.193.104:0/463121948 wait complete. 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: build_initial_monmap 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: monmap: 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:04.646 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 librados: starting msgr at 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 librados: starting objecter 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 Processor -- start 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- start start 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 librados: setting wanted keys 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 librados: calling monclient init 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: init 2026-02-13T08:14:04.647 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient(hunting): picked mon.noname-c con 0x7f342c091740 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient(hunting): picked mon.noname-a con 0x7f342c13f870 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient(hunting): picked mon.noname-b con 0x7f342c13fcd0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342c12cad0 con 0x7f342c13f870 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342c12ec60 con 0x7f342c13fcd0 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342c12d770 con 0x7f342c091740 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient(hunting): authenticate will time out at 950.218631s 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342b7fe640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f342c13f870 0x7f342c12c3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:45028/0 (socket says 10.20.193.104:45028) 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342b7fe640 1 -- 10.20.193.104:0/2578053027 learned_addr learned my addr 10.20.193.104:0/2578053027 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342bfff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f342c091740 0x7f342c12bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57754/0 (socket says 10.20.193.104:57754) 2026-02-13T08:14:04.648 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 client.?.objecter ms_handle_connect 0x7f342c091740 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 client.?.objecter ms_handle_connect 0x7f342c13f870 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2858585186 0 0) 0x7f342c12d770 con 0x7f342c091740 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): my global_id is 104174 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33fc003620 con 0x7f342c091740 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4273490252 0 0) 0x7f342c12cad0 con 0x7f342c13f870 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.649 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): my global_id is 94263 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f342c12d770 con 0x7f342c13f870 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 419683974 0 0) 0x7f33fc003620 con 0x7f342c091740 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f342c12cad0 con 0x7f342c091740 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3418004020 con 0x7f342c091740 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): dump: 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.650 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1852638172 0 0) 0x7f342c12d770 con 0x7f342c13f870 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33fc003620 con 0x7f342c13f870 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 client.?.objecter ms_handle_connect 0x7f342c13fcd0 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f341c003100 con 0x7f342c13f870 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:04.651 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient(hunting): dump: 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1173255447 0 0) 0x7f342c12cad0 con 0x7f342c091740 2026-02-13T08:14:04.652 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 >> v1:10.20.193.119:6789/0 conn(0x7f342c13fcd0 legacy=0x7f342c1917a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 >> v1:10.20.193.104:6789/0 conn(0x7f342c13f870 legacy=0x7f342c12c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient: _finish_hunting 0 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 monclient: found mon.c 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342c12fad0 con 0x7f342c091740 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient: _finish_auth 0 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient: _check_auth_tickets 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 5 monclient: authenticate success, global_id 104174 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: _renew_subs 2026-02-13T08:14:04.653 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- 10.20.193.104:0/2578053027 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f342c12f230 con 0x7f342c091740 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 client.104174.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: _renew_subs 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- 10.20.193.104:0/2578053027 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f342c12e2d0 con 0x7f342c091740 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 librados: init done 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34180026e0 con 0x7f342c091740 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f3418002910 con 0x7f342c091740 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 monclient: dump: 2026-02-13T08:14:04.654 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f342a7fc640 4 set_mon_vals no callback set 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f3418002ab0 con 0x7f342c091740 2026-02-13T08:14:04.655 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:04.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f34325f2640 1 -- 10.20.193.104:0/2578053027 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342c061860 con 0x7f342c091740 2026-02-13T08:14:04.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f341804a480 con 0x7f342c091740 2026-02-13T08:14:04.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 10 client.104174.objecter ms_dispatch2 0x7f342c000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:04.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 3 client.104174.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:04.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 3 client.104174.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:04.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.624+0000 7f3428ff9640 20 client.104174.objecter dump_active .. 0 homeless 2026-02-13T08:14:04.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.628+0000 7f342b7fe640 10 monclient: get_auth_request con 0x7f33fc03b890 auth_method 0 2026-02-13T08:14:04.656 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.628+0000 7f3428ff9640 10 client.104174.objecter ms_handle_connect 0x7f33fc03b890 2026-02-13T08:14:04.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.628+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f3418016ae0 con 0x7f342c091740 2026-02-13T08:14:04.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.628+0000 7f3428ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:04.657 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.628+0000 7f3428ff9640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:04.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.708+0000 7f34325f2640 1 -- 10.20.193.104:0/2578053027 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f342c12f710 con 0x7f33fc03b890 2026-02-13T08:14:04.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f3428ff9640 1 -- 10.20.193.104:0/2578053027 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f341c0058f0 con 0x7f33fc03b890 2026-02-13T08:14:04.719 INFO:teuthology.orchestra.run.trial104.stderr:instructed osd(s) 0 to deep-scrub 2026-02-13T08:14:04.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 10 librados: watch_flush enter 2026-02-13T08:14:04.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 10 librados: watch_flush exit 2026-02-13T08:14:04.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 20 client.104174.objecter shutdown clearing up homeless session... 2026-02-13T08:14:04.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 10 client.104174.objecter successfully canceled tick 2026-02-13T08:14:04.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 1 -- 10.20.193.104:0/2578053027 >> v1:10.20.193.119:6812/276487904 conn(0x7f33fc03b890 legacy=0x7f33fc05bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 10 monclient: shutdown 2026-02-13T08:14:04.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:04.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 1 -- 10.20.193.104:0/2578053027 >> v1:10.20.193.104:6790/0 conn(0x7f342c091740 legacy=0x7f342c12bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 1 -- 10.20.193.104:0/2578053027 shutdown_connections 2026-02-13T08:14:04.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 1 -- 10.20.193.104:0/2578053027 >> 10.20.193.104:0/2578053027 conn(0x7f342c090810 msgr2=0x7f342c08ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:04.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 1 -- 10.20.193.104:0/2578053027 shutdown_connections 2026-02-13T08:14:04.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 1 -- 10.20.193.104:0/2578053027 wait complete. 2026-02-13T08:14:04.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.712+0000 7f34325f2640 1 librados: shutdown 2026-02-13T08:14:04.729 INFO:tasks.ceph:Scrubbing osd.1 2026-02-13T08:14:04.730 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-13T08:14:04.803 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.784+0000 7efca346e640 10 monclient: get_monmap_and_config 2026-02-13T08:14:04.803 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.784+0000 7efca346e640 10 monclient: build_initial_monmap 2026-02-13T08:14:04.804 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.784+0000 7efca346e640 10 monclient: monmap: 2026-02-13T08:14:04.804 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:04.804 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.804 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:04.791169+0000 2026-02-13T08:14:04.804 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:04.791169+0000 2026-02-13T08:14:04.804 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:04.804 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.804 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:04.804 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:04.804 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:04.804 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.784+0000 7efca346e640 1 Processor -- start 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.784+0000 7efca346e640 1 -- start start 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.784+0000 7efca346e640 10 monclient: init 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.784+0000 7efca346e640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient(hunting): picked mon.noname-a con 0x7efc9c05d1d0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient(hunting): picked mon.noname-c con 0x7efc9c160340 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient(hunting): picked mon.noname-b con 0x7efc9c181e40 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9c08b500 con 0x7efc9c05d1d0 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9c08b7e0 con 0x7efc9c160340 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9c08bac0 con 0x7efc9c181e40 2026-02-13T08:14:04.805 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:04.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient(hunting): authenticate will time out at 950.380104s 2026-02-13T08:14:04.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca11e3640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7efc9c05d1d0 0x7efc9c05d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:45034/0 (socket says 10.20.193.104:45034) 2026-02-13T08:14:04.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca11e3640 1 -- 10.20.193.104:0/2329101269 learned_addr learned my addr 10.20.193.104:0/2329101269 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:04.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 -- 10.20.193.104:0/2329101269 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885960811 0 0) 0x7efc9c08bac0 con 0x7efc9c181e40 2026-02-13T08:14:04.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient(hunting): my global_id is 104177 2026-02-13T08:14:04.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 -- 10.20.193.104:0/2329101269 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc84003620 con 0x7efc9c181e40 2026-02-13T08:14:04.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 -- 10.20.193.104:0/2329101269 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960029990 0 0) 0x7efc9c08b500 con 0x7efc9c05d1d0 2026-02-13T08:14:04.806 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient(hunting): my global_id is 94266 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 -- 10.20.193.104:0/2329101269 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc9c08bac0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 -- 10.20.193.104:0/2329101269 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1664167311 0 0) 0x7efc9c08bac0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 -- 10.20.193.104:0/2329101269 >> v1:10.20.193.104:6790/0 conn(0x7efc9c181e40 legacy=0x7efc9c1a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 -- 10.20.193.104:0/2329101269 >> v1:10.20.193.119:6789/0 conn(0x7efc9c160340 legacy=0x7efc9c180720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient: _finish_hunting 0 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 monclient: found mon.noname-a 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:14:04.807 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 -- 10.20.193.104:0/2329101269 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c08a1a0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient: _finish_auth 0 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient: _check_auth_tickets 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 -- 10.20.193.104:0/2329101269 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7efc8c002e00 con 0x7efc9c05d1d0 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient: dump: 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.808 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 5 monclient: authenticate success, global_id 94266 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 -- 10.20.193.104:0/2329101269 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efc8c0030c0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 1 -- 10.20.193.104:0/2329101269 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7efc8c0034c0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:04.809 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8bfff640 10 monclient: dump: 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 4 set_mon_vals no callback set 2026-02-13T08:14:04.810 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: shutdown 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- 10.20.193.104:0/2329101269 >> v1:10.20.193.104:6789/0 conn(0x7efc9c05d1d0 legacy=0x7efc9c05d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- 10.20.193.104:0/2329101269 shutdown_connections 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- 10.20.193.104:0/2329101269 >> 10.20.193.104:0/2329101269 conn(0x7efc9c08d6c0 msgr2=0x7efc9c08dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- 10.20.193.104:0/2329101269 shutdown_connections 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- 10.20.193.104:0/2329101269 wait complete. 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: build_initial_monmap 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: monmap: 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:04.811 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 librados: starting msgr at 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 librados: starting objecter 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 Processor -- start 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- start start 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 librados: setting wanted keys 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 librados: calling monclient init 2026-02-13T08:14:04.812 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: init 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient(hunting): picked mon.noname-c con 0x7efc9c05d1d0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient(hunting): picked mon.noname-b con 0x7efc9c160340 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient(hunting): picked mon.noname-a con 0x7efc9c181e40 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9c13d870 con 0x7efc9c181e40 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9c0865b0 con 0x7efc9c160340 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc9c166fc0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient(hunting): authenticate will time out at 950.382070s 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca11e3640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7efc9c05d1d0 0x7efc9c1640b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57760/0 (socket says 10.20.193.104:57760) 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca11e3640 1 -- 10.20.193.104:0/2166675602 learned_addr learned my addr 10.20.193.104:0/2166675602 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:04.813 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 client.?.objecter ms_handle_connect 0x7efc9c05d1d0 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 client.?.objecter ms_handle_connect 0x7efc9c181e40 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081662792 0 0) 0x7efc9c166fc0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): my global_id is 104180 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc6c003620 con 0x7efc9c05d1d0 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1500538504 0 0) 0x7efc9c13d870 con 0x7efc9c181e40 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.814 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): my global_id is 94269 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc9c166fc0 con 0x7efc9c181e40 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3031180339 0 0) 0x7efc6c003620 con 0x7efc9c05d1d0 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efc9c13d870 con 0x7efc9c05d1d0 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7efc8c002dc0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): dump: 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.815 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3011907259 0 0) 0x7efc9c166fc0 con 0x7efc9c181e40 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efc6c003620 con 0x7efc9c181e40 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7efc98003440 con 0x7efc9c181e40 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient(hunting): dump: 2026-02-13T08:14:04.816 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 443065965 0 0) 0x7efc9c13d870 con 0x7efc9c05d1d0 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 >> v1:10.20.193.119:6789/0 conn(0x7efc9c160340 legacy=0x7efc9c1647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.817 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 >> v1:10.20.193.104:6789/0 conn(0x7efc9c181e40 legacy=0x7efc9c127a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 monclient: found mon.c 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c165ad0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient: _finish_auth 0 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 5 monclient: authenticate success, global_id 104180 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: _renew_subs 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- 10.20.193.104:0/2166675602 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efc9c167b50 con 0x7efc9c05d1d0 2026-02-13T08:14:04.818 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 client.104180.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: _renew_subs 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- 10.20.193.104:0/2166675602 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7efc9c1650a0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 librados: init done 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efc8c0029c0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7efc8c004cf0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient: dump: 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.819 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc8b7fe640 4 set_mon_vals no callback set 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 client.104180.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 15 client.104180.objecter _session_command_op_assign -1 1 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 20 client.104180.objecter _get_session osd=-1 returning homeless 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 client.104180.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:04.820 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca346e640 1 -- 10.20.193.104:0/2166675602 --> v1:10.20.193.104:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7efc9c180c00 con 0x7efc9c05d1d0 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7efc8c010d00 con 0x7efc9c05d1d0 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7efc8c04a590 con 0x7efc9c05d1d0 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 client.104180.objecter ms_dispatch2 0x7efc9c000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 3 client.104180.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 3 client.104180.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 client.104180.objecter checking command 1 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 20 client.104180.objecter _get_session s=0x7efc6c061040 osd=1 3 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 20 client.104180.objecter put_session s=0x7efc6c061040 osd=1 3 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 15 client.104180.objecter _session_command_op_remove -1 1 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 20 client.104180.objecter _get_session s=0x7efc6c061040 osd=1 3 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 20 client.104180.objecter get_session s=0x7efc6c061040 osd=1 3 2026-02-13T08:14:04.821 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 15 client.104180.objecter _session_command_op_assign 1 1 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 20 client.104180.objecter put_session s=0x7efc6c061040 osd=1 4 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 client.104180.objecter _send_command 1 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 --> v1:10.20.193.104:6804/3474406264 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc6c0833f0 con 0x7efc6c0616f0 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 20 client.104180.objecter dump_active .. 0 homeless 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_get_version_reply(handle=1 version=323) ==== 24+0+0 (unknown 3751641255 0 0) 0x7efc8c04a9a0 con 0x7efc9c05d1d0 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 monclient: handle_get_version_reply finishing 1 version 323 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca19e4640 10 monclient: get_auth_request con 0x7efc6c0616f0 auth_method 0 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efca09e2640 10 monclient: get_auth_request con 0x7efc6c03b780 auth_method 0 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.788+0000 7efc89ffb640 10 client.104180.objecter ms_handle_connect 0x7efc6c0616f0 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.792+0000 7efc89ffb640 10 client.104180.objecter ms_handle_connect 0x7efc6c03b780 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.792+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== osd.1 v1:10.20.193.104:6804/3474406264 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7efc6c0833f0 con 0x7efc6c0616f0 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.792+0000 7efc89ffb640 10 client.104180.objecter ms_dispatch2 0x7efc9c000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:14:04.822 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.792+0000 7efc89ffb640 10 client.104180.objecter _finish_command 1 = system:0 2026-02-13T08:14:04.823 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.792+0000 7efc89ffb640 20 client.104180.objecter put_session s=0x7efc6c061040 osd=1 4 2026-02-13T08:14:04.823 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.792+0000 7efc89ffb640 15 client.104180.objecter _session_command_op_remove 1 1 2026-02-13T08:14:04.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 10 client.104180.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-13T08:14:04.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 15 client.104180.objecter _session_command_op_assign -1 2 2026-02-13T08:14:04.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 20 client.104180.objecter _get_session s=0x7efc6c061040 osd=1 3 2026-02-13T08:14:04.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 20 client.104180.objecter put_session s=0x7efc6c061040 osd=1 3 2026-02-13T08:14:04.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 20 client.104180.objecter _get_session s=0x7efc6c061040 osd=1 3 2026-02-13T08:14:04.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 15 client.104180.objecter _session_command_op_remove -1 2 2026-02-13T08:14:04.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 20 client.104180.objecter get_session s=0x7efc6c061040 osd=1 3 2026-02-13T08:14:04.824 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 15 client.104180.objecter _session_command_op_assign 1 2 2026-02-13T08:14:04.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 20 client.104180.objecter put_session s=0x7efc6c061040 osd=1 4 2026-02-13T08:14:04.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 10 client.104180.objecter _send_command 2 2026-02-13T08:14:04.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 1 -- 10.20.193.104:0/2166675602 --> v1:10.20.193.104:6804/3474406264 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efc9c181810 con 0x7efc6c0616f0 2026-02-13T08:14:04.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efc89ffb640 1 -- 10.20.193.104:0/2166675602 <== osd.1 v1:10.20.193.104:6804/3474406264 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7efc9c181810 con 0x7efc6c0616f0 2026-02-13T08:14:04.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efc89ffb640 10 client.104180.objecter ms_dispatch2 0x7efc9c000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:14:04.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efc89ffb640 10 client.104180.objecter _finish_command 2 = system:0 2026-02-13T08:14:04.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efc89ffb640 20 client.104180.objecter put_session s=0x7efc6c061040 osd=1 4 2026-02-13T08:14:04.825 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efc89ffb640 15 client.104180.objecter _session_command_op_remove 1 2 2026-02-13T08:14:04.825 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:14:04.826 INFO:teuthology.orchestra.run.trial104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T08:14:04.826 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:14:04.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 10 librados: watch_flush enter 2026-02-13T08:14:04.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 10 librados: watch_flush exit 2026-02-13T08:14:04.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 10 client.104180.objecter close_session for osd.1 2026-02-13T08:14:04.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 1 -- 10.20.193.104:0/2166675602 >> v1:10.20.193.104:6804/3474406264 conn(0x7efc6c0616f0 legacy=0x7efc6c081b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 20 client.104180.objecter put_session s=0x7efc6c061040 osd=1 1 2026-02-13T08:14:04.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 20 client.104180.objecter shutdown clearing up homeless session... 2026-02-13T08:14:04.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 10 client.104180.objecter successfully canceled tick 2026-02-13T08:14:04.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 1 -- 10.20.193.104:0/2166675602 >> v1:10.20.193.119:6812/276487904 conn(0x7efc6c03b780 legacy=0x7efc6c05bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 10 monclient: shutdown 2026-02-13T08:14:04.828 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:04.829 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 1 -- 10.20.193.104:0/2166675602 >> v1:10.20.193.104:6790/0 conn(0x7efc9c05d1d0 legacy=0x7efc9c1640b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.829 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca19e4640 1 -- 10.20.193.104:0/2166675602 reap_dead start 2026-02-13T08:14:04.829 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 1 -- 10.20.193.104:0/2166675602 shutdown_connections 2026-02-13T08:14:04.829 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 1 -- 10.20.193.104:0/2166675602 >> 10.20.193.104:0/2166675602 conn(0x7efc9c08d6c0 msgr2=0x7efc9c13ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:04.829 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 1 -- 10.20.193.104:0/2166675602 shutdown_connections 2026-02-13T08:14:04.829 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 1 -- 10.20.193.104:0/2166675602 wait complete. 2026-02-13T08:14:04.829 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.796+0000 7efca346e640 1 librados: shutdown 2026-02-13T08:14:04.829 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-13T08:14:04.887 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: get_monmap_and_config 2026-02-13T08:14:04.887 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: build_initial_monmap 2026-02-13T08:14:04.887 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: monmap: 2026-02-13T08:14:04.887 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:04.888 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.888 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:04.884255+0000 2026-02-13T08:14:04.888 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:04.884255+0000 2026-02-13T08:14:04.888 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:04.888 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.888 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:04.888 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:04.888 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:04.888 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.896 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 Processor -- start 2026-02-13T08:14:04.896 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- start start 2026-02-13T08:14:04.896 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: init 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient(hunting): picked mon.noname-c con 0x7fdce8139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient(hunting): picked mon.noname-b con 0x7fdce815e200 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient(hunting): picked mon.noname-a con 0x7fdce817fd00 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce813aa00 con 0x7fdce817fd00 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce808ba20 con 0x7fdce8139f20 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce8089e30 con 0x7fdce815e200 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient(hunting): authenticate will time out at 950.473125s 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce6575640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fdce815e200 0x7fdce817e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57770/0 (socket says 10.20.193.104:57770) 2026-02-13T08:14:04.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce6575640 1 -- 10.20.193.104:0/3518000113 learned_addr learned my addr 10.20.193.104:0/3518000113 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 -- 10.20.193.104:0/3518000113 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461165830 0 0) 0x7fdce8089e30 con 0x7fdce815e200 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient(hunting): my global_id is 104183 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 -- 10.20.193.104:0/3518000113 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcd4003620 con 0x7fdce815e200 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 -- 10.20.193.104:0/3518000113 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1973292910 0 0) 0x7fdcd8002ca0 con 0x7fdce817fd00 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient(hunting): my global_id is 94272 2026-02-13T08:14:04.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 -- 10.20.193.104:0/3518000113 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce8089e30 con 0x7fdce817fd00 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 -- 10.20.193.104:0/3518000113 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3218710707 0 0) 0x7fdcd4003620 con 0x7fdce815e200 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 -- 10.20.193.104:0/3518000113 >> v1:10.20.193.119:6789/0 conn(0x7fdce8139f20 legacy=0x7fdce813a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 -- 10.20.193.104:0/3518000113 >> v1:10.20.193.104:6789/0 conn(0x7fdce817fd00 legacy=0x7fdce81a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient: _finish_hunting 0 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 monclient: found mon.noname-b 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 -- 10.20.193.104:0/3518000113 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce808a380 con 0x7fdce815e200 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient: _finish_auth 0 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient: _check_auth_tickets 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 5 monclient: authenticate success, global_id 104183 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:04.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 -- 10.20.193.104:0/3518000113 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdcd0002e00 con 0x7fdce815e200 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient: dump: 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.900 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 -- 10.20.193.104:0/3518000113 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcd0003010 con 0x7fdce815e200 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 1 -- 10.20.193.104:0/3518000113 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdcd0003450 con 0x7fdce815e200 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 4 set_mon_vals no callback set 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5d74640 10 monclient: dump: 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.901 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: shutdown 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- 10.20.193.104:0/3518000113 >> v1:10.20.193.104:6790/0 conn(0x7fdce815e200 legacy=0x7fdce817e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- 10.20.193.104:0/3518000113 shutdown_connections 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- 10.20.193.104:0/3518000113 >> 10.20.193.104:0/3518000113 conn(0x7fdce8051a50 msgr2=0x7fdce8051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:04.902 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- 10.20.193.104:0/3518000113 shutdown_connections 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- 10.20.193.104:0/3518000113 wait complete. 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: build_initial_monmap 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: monmap: 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:04.903 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 librados: starting msgr at 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 librados: starting objecter 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 Processor -- start 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- start start 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 librados: setting wanted keys 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 librados: calling monclient init 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: init 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient(hunting): picked mon.noname-c con 0x7fdce8139f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient(hunting): picked mon.noname-b con 0x7fdce815e200 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:04.904 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient(hunting): picked mon.noname-a con 0x7fdce817fd00 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce8162ba0 con 0x7fdce817fd00 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce8162e80 con 0x7fdce815e200 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce817ee20 con 0x7fdce8139f20 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient(hunting): authenticate will time out at 950.474844s 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce6d76640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fdce8139f20 0x7fdce817e000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57776/0 (socket says 10.20.193.104:57776) 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce6d76640 1 -- 10.20.193.104:0/3433208605 learned_addr learned my addr 10.20.193.104:0/3433208605 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 client.?.objecter ms_handle_connect 0x7fdce817fd00 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 client.?.objecter ms_handle_connect 0x7fdce8139f20 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3199394430 0 0) 0x7fdce8162ba0 con 0x7fdce817fd00 2026-02-13T08:14:04.905 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): my global_id is 94275 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcb4003620 con 0x7fdce817fd00 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3852245027 0 0) 0x7fdce817ee20 con 0x7fdce8139f20 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): my global_id is 104186 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce8162ba0 con 0x7fdce8139f20 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 432429480 0 0) 0x7fdcb4003620 con 0x7fdce817fd00 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdce817ee20 con 0x7fdce817fd00 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdcd8003610 con 0x7fdce817fd00 2026-02-13T08:14:04.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): dump: 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4110681885 0 0) 0x7fdce8162ba0 con 0x7fdce8139f20 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcb4003620 con 0x7fdce8139f20 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdcdc0031a0 con 0x7fdce8139f20 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient(hunting): dump: 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.908 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1894693425 0 0) 0x7fdce817ee20 con 0x7fdce817fd00 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 >> v1:10.20.193.104:6790/0 conn(0x7fdce8139f20 legacy=0x7fdce817e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 >> v1:10.20.193.119:6789/0 conn(0x7fdce815e200 legacy=0x7fdce817e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient: _finish_hunting 0 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 monclient: found mon.a 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce8162010 con 0x7fdce817fd00 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient: _finish_auth 0 2026-02-13T08:14:04.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient: _check_auth_tickets 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 5 monclient: authenticate success, global_id 94275 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: _renew_subs 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- 10.20.193.104:0/3433208605 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdce8160b20 con 0x7fdce817fd00 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 client.94275.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: _renew_subs 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- 10.20.193.104:0/3433208605 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdce817fa60 con 0x7fdce817fd00 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 librados: init done 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcd8003a90 con 0x7fdce817fd00 2026-02-13T08:14:04.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fdcd8003de0 con 0x7fdce817fd00 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdce5573640 4 set_mon_vals no callback set 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 10 monclient: dump: 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:04.911 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdced076640 1 -- 10.20.193.104:0/3433208605 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce8061860 con 0x7fdce817fd00 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.880+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fdcd800fdf0 con 0x7fdce817fd00 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.884+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7fdcd8049640 con 0x7fdce817fd00 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.884+0000 7fdcc77fe640 10 client.94275.objecter ms_dispatch2 0x7fdce8000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.884+0000 7fdcc77fe640 3 client.94275.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.884+0000 7fdcc77fe640 3 client.94275.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.884+0000 7fdcc77fe640 20 client.94275.objecter dump_active .. 0 homeless 2026-02-13T08:14:04.912 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.884+0000 7fdce6d76640 10 monclient: get_auth_request con 0x7fdcb403b840 auth_method 0 2026-02-13T08:14:04.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.884+0000 7fdcc77fe640 10 client.94275.objecter ms_handle_connect 0x7fdcb403b840 2026-02-13T08:14:04.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.884+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7fdce813aa00 con 0x7fdce817fd00 2026-02-13T08:14:04.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.884+0000 7fdcc77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:04.913 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.884+0000 7fdcc77fe640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:04.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 1 -- 10.20.193.104:0/3433208605 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fdce8088e20 con 0x7fdcb403b840 2026-02-13T08:14:04.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdcc77fe640 1 -- 10.20.193.104:0/3433208605 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7fdce8088e20 con 0x7fdcb403b840 2026-02-13T08:14:04.977 INFO:teuthology.orchestra.run.trial104.stderr:instructed osd(s) 1 to deep-scrub 2026-02-13T08:14:04.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 10 librados: watch_flush enter 2026-02-13T08:14:04.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 10 librados: watch_flush exit 2026-02-13T08:14:04.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 20 client.94275.objecter shutdown clearing up homeless session... 2026-02-13T08:14:04.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 10 client.94275.objecter successfully canceled tick 2026-02-13T08:14:04.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 1 -- 10.20.193.104:0/3433208605 >> v1:10.20.193.119:6812/276487904 conn(0x7fdcb403b840 legacy=0x7fdcb405bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 10 monclient: shutdown 2026-02-13T08:14:04.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:04.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 1 -- 10.20.193.104:0/3433208605 >> v1:10.20.193.104:6789/0 conn(0x7fdce817fd00 legacy=0x7fdce8127ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:04.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 1 -- 10.20.193.104:0/3433208605 shutdown_connections 2026-02-13T08:14:04.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 1 -- 10.20.193.104:0/3433208605 >> 10.20.193.104:0/3433208605 conn(0x7fdce8051a50 msgr2=0x7fdce813abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:04.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 1 -- 10.20.193.104:0/3433208605 shutdown_connections 2026-02-13T08:14:04.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 1 -- 10.20.193.104:0/3433208605 wait complete. 2026-02-13T08:14:04.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:04.968+0000 7fdced076640 1 librados: shutdown 2026-02-13T08:14:04.987 INFO:tasks.ceph:Scrubbing osd.2 2026-02-13T08:14:04.987 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-13T08:14:05.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: get_monmap_and_config 2026-02-13T08:14:05.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.056 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: monmap: 2026-02-13T08:14:05.056 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.056 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.056 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:05.052654+0000 2026-02-13T08:14:05.056 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:05.052654+0000 2026-02-13T08:14:05.056 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.057 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.057 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.057 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:05.057 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:05.057 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 Processor -- start 2026-02-13T08:14:05.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- start start 2026-02-13T08:14:05.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: init 2026-02-13T08:14:05.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:14:05.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient(hunting): picked mon.noname-c con 0x7fc56805d1d0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient(hunting): picked mon.noname-a con 0x7fc568160340 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient(hunting): picked mon.noname-b con 0x7fc568181e40 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc56808b500 con 0x7fc568160340 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc56808b7e0 con 0x7fc56805d1d0 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc56808bac0 con 0x7fc568181e40 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient(hunting): authenticate will time out at 950.641597s 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d9a7640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fc568160340 0x7fc568180720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:45070/0 (socket says 10.20.193.104:45070) 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d9a7640 1 -- 10.20.193.104:0/3135709010 learned_addr learned my addr 10.20.193.104:0/3135709010 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3557477521 0 0) 0x7fc56808bac0 con 0x7fc568181e40 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): my global_id is 104189 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc550003620 con 0x7fc568181e40 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356275506 0 0) 0x7fc56808b500 con 0x7fc568160340 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): my global_id is 94278 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc56808bac0 con 0x7fc568160340 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439492975 0 0) 0x7fc56808b7e0 con 0x7fc56805d1d0 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient(hunting): my global_id is 74737 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc56808b500 con 0x7fc56805d1d0 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3040342037 0 0) 0x7fc550003620 con 0x7fc568181e40 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 >> v1:10.20.193.119:6789/0 conn(0x7fc56805d1d0 legacy=0x7fc56805d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 >> v1:10.20.193.104:6789/0 conn(0x7fc568160340 legacy=0x7fc568180720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 monclient: found mon.noname-b 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56808a1a0 con 0x7fc568181e40 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc564003180 con 0x7fc568181e40 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient: dump: 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.072 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 5 monclient: authenticate success, global_id 104189 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc564003390 con 0x7fc568181e40 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 1 -- 10.20.193.104:0/3135709010 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc5640037a0 con 0x7fc568181e40 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56d1a6640 10 monclient: dump: 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.073 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 4 set_mon_vals no callback set 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: shutdown 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- 10.20.193.104:0/3135709010 >> v1:10.20.193.104:6790/0 conn(0x7fc568181e40 legacy=0x7fc5681a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- 10.20.193.104:0/3135709010 shutdown_connections 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- 10.20.193.104:0/3135709010 >> 10.20.193.104:0/3135709010 conn(0x7fc56808d6c0 msgr2=0x7fc56808dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- 10.20.193.104:0/3135709010 shutdown_connections 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- 10.20.193.104:0/3135709010 wait complete. 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: monmap: 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.075 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 librados: starting msgr at 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 librados: starting objecter 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 Processor -- start 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- start start 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 librados: setting wanted keys 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 librados: calling monclient init 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: init 2026-02-13T08:14:05.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: _add_conns ranks=[2,1,0] 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient(hunting): picked mon.noname-c con 0x7fc56805d1d0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient(hunting): picked mon.noname-b con 0x7fc568160340 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient(hunting): picked mon.noname-a con 0x7fc568181e40 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc568165030 con 0x7fc568181e40 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc56813d960 con 0x7fc568160340 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5680865b0 con 0x7fc56805d1d0 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient(hunting): authenticate will time out at 950.643420s 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56e1a8640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fc56805d1d0 0x7fc568164210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57808/0 (socket says 10.20.193.104:57808) 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56e1a8640 1 -- 10.20.193.104:0/3792619538 learned_addr learned my addr 10.20.193.104:0/3792619538 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc56e9a9640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fc568181e40 0x7fc568127a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:45072/0 (socket says 10.20.193.104:45072) 2026-02-13T08:14:05.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 client.?.objecter ms_handle_connect 0x7fc568181e40 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 client.?.objecter ms_handle_connect 0x7fc56805d1d0 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2851099542 0 0) 0x7fc568165030 con 0x7fc568181e40 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): my global_id is 94281 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc538003620 con 0x7fc568181e40 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74416003 0 0) 0x7fc5680865b0 con 0x7fc56805d1d0 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): my global_id is 104192 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc568165030 con 0x7fc56805d1d0 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 client.?.objecter ms_handle_connect 0x7fc568160340 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3456074432 0 0) 0x7fc538003620 con 0x7fc568181e40 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5680865b0 con 0x7fc568181e40 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc564003090 con 0x7fc568181e40 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): dump: 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.079 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3562637738 0 0) 0x7fc568165030 con 0x7fc56805d1d0 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc538003620 con 0x7fc56805d1d0 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc558003100 con 0x7fc56805d1d0 2026-02-13T08:14:05.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient(hunting): dump: 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2960896724 0 0) 0x7fc5680865b0 con 0x7fc568181e40 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 >> v1:10.20.193.104:6790/0 conn(0x7fc56805d1d0 legacy=0x7fc568164210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 >> v1:10.20.193.119:6789/0 conn(0x7fc568160340 legacy=0x7fc568164920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 monclient: found mon.a 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc568167170 con 0x7fc568181e40 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 5 monclient: authenticate success, global_id 94281 2026-02-13T08:14:05.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: _renew_subs 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- 10.20.193.104:0/3792619538 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc568165c80 con 0x7fc568181e40 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 client.94281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: _renew_subs 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 -- 10.20.193.104:0/3792619538 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc568181b90 con 0x7fc568181e40 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc570433640 1 librados: init done 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc564003340 con 0x7fc568181e40 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.048+0000 7fc54effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc564003e70 con 0x7fc568181e40 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:05.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 10 monclient: dump: 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc56c9a5640 4 set_mon_vals no callback set 2026-02-13T08:14:05.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc570433640 10 client.94281.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc570433640 15 client.94281.objecter _session_command_op_assign -1 1 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc570433640 20 client.94281.objecter _get_session osd=-1 returning homeless 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc570433640 10 client.94281.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc570433640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc570433640 1 -- 10.20.193.104:0/3792619538 --> v1:10.20.193.104:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc56808a460 con 0x7fc568181e40 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fc564004010 con 0x7fc568181e40 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7fc56404a6e0 con 0x7fc568181e40 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 10 client.94281.objecter ms_dispatch2 0x7fc568000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 3 client.94281.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 3 client.94281.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 10 client.94281.objecter checking command 1 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 20 client.94281.objecter _get_session s=0x7fc538061130 osd=2 3 2026-02-13T08:14:05.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 20 client.94281.objecter put_session s=0x7fc538061130 osd=2 3 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 15 client.94281.objecter _session_command_op_remove -1 1 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 20 client.94281.objecter _get_session s=0x7fc538061130 osd=2 3 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 20 client.94281.objecter get_session s=0x7fc538061130 osd=2 3 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 15 client.94281.objecter _session_command_op_assign 2 1 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 20 client.94281.objecter put_session s=0x7fc538061130 osd=2 4 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 10 client.94281.objecter _send_command 1 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 --> v1:10.20.193.104:6800/3938786817 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5380834e0 con 0x7fc5380617e0 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 20 client.94281.objecter dump_active .. 0 homeless 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_get_version_reply(handle=1 version=323) ==== 24+0+0 (unknown 3751641255 0 0) 0x7fc56404aaf0 con 0x7fc568181e40 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 10 monclient: handle_get_version_reply finishing 1 version 323 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc56e1a8640 10 monclient: get_auth_request con 0x7fc53803b870 auth_method 0 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc56d9a7640 10 monclient: get_auth_request con 0x7fc5380617e0 auth_method 0 2026-02-13T08:14:05.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 10 client.94281.objecter ms_handle_connect 0x7fc5380617e0 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 10 client.94281.objecter ms_handle_connect 0x7fc53803b870 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== osd.2 v1:10.20.193.104:6800/3938786817 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fc5380834e0 con 0x7fc5380617e0 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 10 client.94281.objecter ms_dispatch2 0x7fc568000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 10 client.94281.objecter _finish_command 1 = system:0 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 20 client.94281.objecter put_session s=0x7fc538061130 osd=2 4 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.052+0000 7fc54effd640 15 client.94281.objecter _session_command_op_remove 2 1 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.056+0000 7fc570433640 10 client.94281.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.056+0000 7fc570433640 15 client.94281.objecter _session_command_op_assign -1 2 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.056+0000 7fc570433640 20 client.94281.objecter _get_session s=0x7fc538061130 osd=2 3 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.056+0000 7fc570433640 20 client.94281.objecter put_session s=0x7fc538061130 osd=2 3 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.056+0000 7fc570433640 20 client.94281.objecter _get_session s=0x7fc538061130 osd=2 3 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.056+0000 7fc570433640 15 client.94281.objecter _session_command_op_remove -1 2 2026-02-13T08:14:05.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.056+0000 7fc570433640 20 client.94281.objecter get_session s=0x7fc538061130 osd=2 3 2026-02-13T08:14:05.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.056+0000 7fc570433640 15 client.94281.objecter _session_command_op_assign 2 2 2026-02-13T08:14:05.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.056+0000 7fc570433640 20 client.94281.objecter put_session s=0x7fc538061130 osd=2 4 2026-02-13T08:14:05.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.056+0000 7fc570433640 10 client.94281.objecter _send_command 2 2026-02-13T08:14:05.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.056+0000 7fc570433640 1 -- 10.20.193.104:0/3792619538 --> v1:10.20.193.104:6800/3938786817 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc568166a90 con 0x7fc5380617e0 2026-02-13T08:14:05.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc54effd640 1 -- 10.20.193.104:0/3792619538 <== osd.2 v1:10.20.193.104:6800/3938786817 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc568166a90 con 0x7fc5380617e0 2026-02-13T08:14:05.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc54effd640 10 client.94281.objecter ms_dispatch2 0x7fc568000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:14:05.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc54effd640 10 client.94281.objecter _finish_command 2 = system:0 2026-02-13T08:14:05.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc54effd640 20 client.94281.objecter put_session s=0x7fc538061130 osd=2 4 2026-02-13T08:14:05.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc54effd640 15 client.94281.objecter _session_command_op_remove 2 2 2026-02-13T08:14:05.089 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:14:05.089 INFO:teuthology.orchestra.run.trial104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T08:14:05.089 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 10 librados: watch_flush enter 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 10 librados: watch_flush exit 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 10 client.94281.objecter close_session for osd.2 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 1 -- 10.20.193.104:0/3792619538 >> v1:10.20.193.104:6800/3938786817 conn(0x7fc5380617e0 legacy=0x7fc538081c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 20 client.94281.objecter put_session s=0x7fc538061130 osd=2 1 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 20 client.94281.objecter shutdown clearing up homeless session... 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 10 client.94281.objecter successfully canceled tick 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 1 -- 10.20.193.104:0/3792619538 >> v1:10.20.193.119:6812/276487904 conn(0x7fc53803b870 legacy=0x7fc53805bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 10 monclient: shutdown 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 1 -- 10.20.193.104:0/3792619538 >> v1:10.20.193.104:6789/0 conn(0x7fc568181e40 legacy=0x7fc568127a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc56e9a9640 1 -- 10.20.193.104:0/3792619538 reap_dead start 2026-02-13T08:14:05.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 1 -- 10.20.193.104:0/3792619538 shutdown_connections 2026-02-13T08:14:05.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 1 -- 10.20.193.104:0/3792619538 >> 10.20.193.104:0/3792619538 conn(0x7fc56808d6c0 msgr2=0x7fc56813ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 1 -- 10.20.193.104:0/3792619538 shutdown_connections 2026-02-13T08:14:05.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 1 -- 10.20.193.104:0/3792619538 wait complete. 2026-02-13T08:14:05.092 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.060+0000 7fc570433640 1 librados: shutdown 2026-02-13T08:14:05.092 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-13T08:14:05.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.148+0000 7f4d671f9640 10 monclient: get_monmap_and_config 2026-02-13T08:14:05.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.148+0000 7f4d671f9640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.148+0000 7f4d671f9640 10 monclient: monmap: 2026-02-13T08:14:05.158 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.159 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.159 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:05.155239+0000 2026-02-13T08:14:05.159 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:05.155239+0000 2026-02-13T08:14:05.159 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.159 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.159 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.159 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:05.159 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:05.159 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.148+0000 7f4d671f9640 1 Processor -- start 2026-02-13T08:14:05.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.148+0000 7f4d671f9640 1 -- start start 2026-02-13T08:14:05.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.148+0000 7f4d671f9640 10 monclient: init 2026-02-13T08:14:05.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:14:05.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient(hunting): picked mon.noname-a con 0x7f4d60090a00 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient(hunting): picked mon.noname-b con 0x7f4d6008c7e0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient(hunting): picked mon.noname-c con 0x7f4d6008cbe0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d60057a20 con 0x7f4d60090a00 2026-02-13T08:14:05.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6008ef90 con 0x7f4d6008cbe0 2026-02-13T08:14:05.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6008da30 con 0x7f4d6008c7e0 2026-02-13T08:14:05.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient(hunting): authenticate will time out at 950.744376s 2026-02-13T08:14:05.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d64f6e640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f4d60090a00 0x7f4d6008c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:45088/0 (socket says 10.20.193.104:45088) 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d64f6e640 1 -- 10.20.193.104:0/1539040315 learned_addr learned my addr 10.20.193.104:0/1539040315 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 -- 10.20.193.104:0/1539040315 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4258116536 0 0) 0x7f4d6008da30 con 0x7f4d6008c7e0 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient(hunting): my global_id is 104195 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 -- 10.20.193.104:0/1539040315 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d4c003620 con 0x7f4d6008c7e0 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 -- 10.20.193.104:0/1539040315 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270450106 0 0) 0x7f4d60057a20 con 0x7f4d60090a00 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient(hunting): my global_id is 94284 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 -- 10.20.193.104:0/1539040315 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d6008da30 con 0x7f4d60090a00 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 -- 10.20.193.104:0/1539040315 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3510976375 0 0) 0x7f4d4c003620 con 0x7f4d6008c7e0 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 -- 10.20.193.104:0/1539040315 >> v1:10.20.193.119:6789/0 conn(0x7f4d6008cbe0 legacy=0x7f4d601a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 -- 10.20.193.104:0/1539040315 >> v1:10.20.193.104:6789/0 conn(0x7f4d60090a00 legacy=0x7f4d6008c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 monclient: found mon.noname-b 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 -- 10.20.193.104:0/1539040315 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d60090f10 con 0x7f4d6008c7e0 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 -- 10.20.193.104:0/1539040315 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4d48002d30 con 0x7f4d6008c7e0 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient: dump: 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.171 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 5 monclient: authenticate success, global_id 104195 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 -- 10.20.193.104:0/1539040315 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d48002fb0 con 0x7f4d6008c7e0 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 1 -- 10.20.193.104:0/1539040315 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4d480033f0 con 0x7f4d6008c7e0 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d577fe640 10 monclient: dump: 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.172 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 4 set_mon_vals no callback set 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: shutdown 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- 10.20.193.104:0/1539040315 >> v1:10.20.193.104:6790/0 conn(0x7f4d6008c7e0 legacy=0x7f4d601805b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.173 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- 10.20.193.104:0/1539040315 shutdown_connections 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- 10.20.193.104:0/1539040315 >> 10.20.193.104:0/1539040315 conn(0x7f4d6008e1d0 msgr2=0x7f4d6008e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- 10.20.193.104:0/1539040315 shutdown_connections 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- 10.20.193.104:0/1539040315 wait complete. 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: monmap: 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.174 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 librados: starting msgr at 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 librados: starting objecter 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 Processor -- start 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- start start 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 librados: setting wanted keys 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 librados: calling monclient init 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: init 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:14:05.175 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient(hunting): picked mon.noname-a con 0x7f4d6008c7e0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient(hunting): picked mon.noname-c con 0x7f4d6008cbe0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient(hunting): picked mon.noname-b con 0x7f4d60090a00 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d6005d2a0 con 0x7f4d6008c7e0 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d60087790 con 0x7f4d60090a00 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d600888c0 con 0x7f4d6008cbe0 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient(hunting): authenticate will time out at 950.746777s 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d64f6e640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f4d6008c7e0 0x7f4d601272f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:45094/0 (socket says 10.20.193.104:45094) 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d64f6e640 1 -- 10.20.193.104:0/1235897865 learned_addr learned my addr 10.20.193.104:0/1235897865 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 client.?.objecter ms_handle_connect 0x7f4d6008c7e0 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 client.?.objecter ms_handle_connect 0x7f4d6008cbe0 2026-02-13T08:14:05.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045510378 0 0) 0x7f4d6005d2a0 con 0x7f4d6008c7e0 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): my global_id is 94287 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d30003620 con 0x7f4d6008c7e0 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793220202 0 0) 0x7f4d600888c0 con 0x7f4d6008cbe0 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): my global_id is 104198 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d6005d2a0 con 0x7f4d6008cbe0 2026-02-13T08:14:05.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 865807059 0 0) 0x7f4d30003620 con 0x7f4d6008c7e0 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d600888c0 con 0x7f4d6008c7e0 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4d50003100 con 0x7f4d6008c7e0 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): dump: 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.178 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3024691901 0 0) 0x7f4d6005d2a0 con 0x7f4d6008cbe0 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d30003620 con 0x7f4d6008cbe0 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4d48003300 con 0x7f4d6008cbe0 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient(hunting): dump: 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.179 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 client.?.objecter ms_handle_connect 0x7f4d60090a00 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4082891202 0 0) 0x7f4d600888c0 con 0x7f4d6008c7e0 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 >> v1:10.20.193.104:6790/0 conn(0x7f4d6008cbe0 legacy=0x7f4d601a05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 >> v1:10.20.193.119:6789/0 conn(0x7f4d60090a00 legacy=0x7f4d601a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 monclient: found mon.a 2026-02-13T08:14:05.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6005cfc0 con 0x7f4d6008c7e0 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 5 monclient: authenticate success, global_id 94287 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: _renew_subs 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- 10.20.193.104:0/1235897865 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6005b820 con 0x7f4d6008c7e0 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 client.94287.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: _renew_subs 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- 10.20.193.104:0/1235897865 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d60127a00 con 0x7f4d6008c7e0 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 librados: init done 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d500048e0 con 0x7f4d6008c7e0 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f4d50004c30 con 0x7f4d6008c7e0 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 10 monclient: dump: 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.182 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d56ffd640 4 set_mon_vals no callback set 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d671f9640 1 -- 10.20.193.104:0/1235897865 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d60061860 con 0x7f4d6008c7e0 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.152+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f4d50010c40 con 0x7f4d6008c7e0 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.156+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f4d5004a510 con 0x7f4d6008c7e0 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.156+0000 7f4d557fa640 10 client.94287.objecter ms_dispatch2 0x7f4d60000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:05.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.156+0000 7f4d557fa640 3 client.94287.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:05.184 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.156+0000 7f4d557fa640 3 client.94287.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:05.184 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.156+0000 7f4d557fa640 20 client.94287.objecter dump_active .. 0 homeless 2026-02-13T08:14:05.184 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.156+0000 7f4d57fff640 10 monclient: get_auth_request con 0x7f4d3003b840 auth_method 0 2026-02-13T08:14:05.184 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.156+0000 7f4d557fa640 10 client.94287.objecter ms_handle_connect 0x7f4d3003b840 2026-02-13T08:14:05.184 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.156+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f4d50016c30 con 0x7f4d6008c7e0 2026-02-13T08:14:05.184 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.156+0000 7f4d557fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.184 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.156+0000 7f4d557fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:05.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.236+0000 7f4d671f9640 1 -- 10.20.193.104:0/1235897865 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f4d601a3610 con 0x7f4d3003b840 2026-02-13T08:14:05.247 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d557fa640 1 -- 10.20.193.104:0/1235897865 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f4d601a3610 con 0x7f4d3003b840 2026-02-13T08:14:05.248 INFO:teuthology.orchestra.run.trial104.stderr:instructed osd(s) 2 to deep-scrub 2026-02-13T08:14:05.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 10 librados: watch_flush enter 2026-02-13T08:14:05.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 10 librados: watch_flush exit 2026-02-13T08:14:05.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 20 client.94287.objecter shutdown clearing up homeless session... 2026-02-13T08:14:05.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 10 client.94287.objecter successfully canceled tick 2026-02-13T08:14:05.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 1 -- 10.20.193.104:0/1235897865 >> v1:10.20.193.119:6812/276487904 conn(0x7f4d3003b840 legacy=0x7f4d3005bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 10 monclient: shutdown 2026-02-13T08:14:05.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.249 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 1 -- 10.20.193.104:0/1235897865 >> v1:10.20.193.104:6789/0 conn(0x7f4d6008c7e0 legacy=0x7f4d601272f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 1 -- 10.20.193.104:0/1235897865 shutdown_connections 2026-02-13T08:14:05.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 1 -- 10.20.193.104:0/1235897865 >> 10.20.193.104:0/1235897865 conn(0x7f4d6008e1d0 msgr2=0x7f4d60085e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 1 -- 10.20.193.104:0/1235897865 shutdown_connections 2026-02-13T08:14:05.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 1 -- 10.20.193.104:0/1235897865 wait complete. 2026-02-13T08:14:05.250 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.240+0000 7f4d671f9640 1 librados: shutdown 2026-02-13T08:14:05.257 INFO:tasks.ceph:Scrubbing osd.3 2026-02-13T08:14:05.257 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-13T08:14:05.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.312+0000 7f32b03a2640 10 monclient: get_monmap_and_config 2026-02-13T08:14:05.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.312+0000 7f32b03a2640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.312+0000 7f32b03a2640 10 monclient: monmap: 2026-02-13T08:14:05.323 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.323 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.323 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:05.319235+0000 2026-02-13T08:14:05.323 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:05.319235+0000 2026-02-13T08:14:05.323 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.323 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.323 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.323 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:05.323 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:05.324 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.312+0000 7f32b03a2640 1 Processor -- start 2026-02-13T08:14:05.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.312+0000 7f32b03a2640 1 -- start start 2026-02-13T08:14:05.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.312+0000 7f32b03a2640 10 monclient: init 2026-02-13T08:14:05.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:05.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient(hunting): picked mon.noname-c con 0x7f32a8051880 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient(hunting): picked mon.noname-b con 0x7f32a8052360 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient(hunting): picked mon.noname-a con 0x7f32a817fad0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a808abb0 con 0x7f32a817fad0 2026-02-13T08:14:05.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a8089f30 con 0x7f32a8051880 2026-02-13T08:14:05.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a808a5f0 con 0x7f32a8052360 2026-02-13T08:14:05.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient(hunting): authenticate will time out at 950.908208s 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad916640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f32a8052360 0x7f32a817e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57834/0 (socket says 10.20.193.104:57834) 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ae918640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f32a817fad0 0x7f32a819feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:45100/0 (socket says 10.20.193.104:45100) 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad916640 1 -- 10.20.193.104:0/1828817428 learned_addr learned my addr 10.20.193.104:0/1828817428 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 -- 10.20.193.104:0/1828817428 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381365475 0 0) 0x7f32a4002bd0 con 0x7f32a817fad0 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient(hunting): my global_id is 94290 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 -- 10.20.193.104:0/1828817428 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3290003620 con 0x7f32a817fad0 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 -- 10.20.193.104:0/1828817428 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475649019 0 0) 0x7f32a808a5f0 con 0x7f32a8052360 2026-02-13T08:14:05.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient(hunting): my global_id is 104201 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 -- 10.20.193.104:0/1828817428 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32a4002bd0 con 0x7f32a8052360 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 -- 10.20.193.104:0/1828817428 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3179838277 0 0) 0x7f3290003620 con 0x7f32a817fad0 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 -- 10.20.193.104:0/1828817428 >> v1:10.20.193.104:6790/0 conn(0x7f32a8052360 legacy=0x7f32a817e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 -- 10.20.193.104:0/1828817428 >> v1:10.20.193.119:6789/0 conn(0x7f32a8051880 legacy=0x7f32a8051c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 monclient: found mon.noname-a 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 -- 10.20.193.104:0/1828817428 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a808a8d0 con 0x7f32a817fad0 2026-02-13T08:14:05.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 -- 10.20.193.104:0/1828817428 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f32a4003280 con 0x7f32a817fad0 2026-02-13T08:14:05.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:05.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient: dump: 2026-02-13T08:14:05.335 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.335 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.335 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.335 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 5 monclient: authenticate success, global_id 94290 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 -- 10.20.193.104:0/1828817428 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32a4003490 con 0x7f32a817fad0 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 1 -- 10.20.193.104:0/1828817428 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f32a40038d0 con 0x7f32a817fad0 2026-02-13T08:14:05.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad115640 10 monclient: dump: 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:05.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 4 set_mon_vals no callback set 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: shutdown 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- 10.20.193.104:0/1828817428 >> v1:10.20.193.104:6789/0 conn(0x7f32a817fad0 legacy=0x7f32a819feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- 10.20.193.104:0/1828817428 shutdown_connections 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- 10.20.193.104:0/1828817428 >> 10.20.193.104:0/1828817428 conn(0x7f32a808d6c0 msgr2=0x7f32a808dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- 10.20.193.104:0/1828817428 shutdown_connections 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- 10.20.193.104:0/1828817428 wait complete. 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: monmap: 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:05.338 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 librados: starting msgr at 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 librados: starting objecter 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 Processor -- start 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- start start 2026-02-13T08:14:05.339 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 librados: setting wanted keys 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 librados: calling monclient init 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: init 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient(hunting): picked mon.noname-b con 0x7f32a8051880 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient(hunting): picked mon.noname-c con 0x7f32a8052360 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient(hunting): picked mon.noname-a con 0x7f32a817fad0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a810bcc0 con 0x7f32a817fad0 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a812b1e0 con 0x7f32a8051880 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a810ae50 con 0x7f32a8052360 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient(hunting): authenticate will time out at 950.910604s 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad916640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f32a8052360 0x7f32a812aad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57846/0 (socket says 10.20.193.104:57846) 2026-02-13T08:14:05.340 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ad916640 1 -- 10.20.193.104:0/533621735 learned_addr learned my addr 10.20.193.104:0/533621735 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 client.?.objecter ms_handle_connect 0x7f32a8052360 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 client.?.objecter ms_handle_connect 0x7f32a817fad0 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291494042 0 0) 0x7f32a810ae50 con 0x7f32a8052360 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): my global_id is 104204 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3278003620 con 0x7f32a8052360 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928457758 0 0) 0x7f32a810bcc0 con 0x7f32a817fad0 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): my global_id is 94293 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32a810ae50 con 0x7f32a817fad0 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 client.?.objecter ms_handle_connect 0x7f32a8051880 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1455739551 0 0) 0x7f3278003620 con 0x7f32a8052360 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32a810bcc0 con 0x7f32a8052360 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f329c003100 con 0x7f32a8052360 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): dump: 2026-02-13T08:14:05.342 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2121147665 0 0) 0x7f32a812b1e0 con 0x7f32a8051880 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): my global_id is 74749 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3278003620 con 0x7f32a8051880 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3414288580 0 0) 0x7f32a810ae50 con 0x7f32a817fad0 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32a812b1e0 con 0x7f32a817fad0 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f32a4003190 con 0x7f32a817fad0 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient(hunting): dump: 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.344 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3309098655 0 0) 0x7f32a810bcc0 con 0x7f32a8052360 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 >> v1:10.20.193.119:6789/0 conn(0x7f32a8051880 legacy=0x7f32a812a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 >> v1:10.20.193.104:6789/0 conn(0x7f32a817fad0 legacy=0x7f32a817f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 monclient: found mon.c 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.345 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a8109960 con 0x7f32a8052360 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 5 monclient: authenticate success, global_id 104204 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: _renew_subs 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- 10.20.193.104:0/533621735 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f32a810b420 con 0x7f32a8052360 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 client.104204.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: _renew_subs 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- 10.20.193.104:0/533621735 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f32a810a690 con 0x7f32a8052360 2026-02-13T08:14:05.346 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 librados: init done 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f329c0048e0 con 0x7f32a8052360 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f329c004c30 con 0x7f32a8052360 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 monclient: dump: 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.347 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32ac914640 4 set_mon_vals no callback set 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 client.104204.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 15 client.104204.objecter _session_command_op_assign -1 1 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 20 client.104204.objecter _get_session osd=-1 returning homeless 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 client.104204.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f32b03a2640 1 -- 10.20.193.104:0/533621735 --> v1:10.20.193.104:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3274003960 con 0x7f32a8052360 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f329c004dd0 con 0x7f32a8052360 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f329c04a620 con 0x7f32a8052360 2026-02-13T08:14:05.348 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 10 client.104204.objecter ms_dispatch2 0x7f32a8000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 3 client.104204.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.316+0000 7f328effd640 3 client.104204.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 10 client.104204.objecter checking command 1 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 20 client.104204.objecter _get_session s=0x7f32780613e0 osd=3 3 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 20 client.104204.objecter put_session s=0x7f32780613e0 osd=3 3 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 15 client.104204.objecter _session_command_op_remove -1 1 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 20 client.104204.objecter _get_session s=0x7f32780613e0 osd=3 3 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 20 client.104204.objecter get_session s=0x7f32780613e0 osd=3 3 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 15 client.104204.objecter _session_command_op_assign 3 1 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 20 client.104204.objecter put_session s=0x7f32780613e0 osd=3 4 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 10 client.104204.objecter _send_command 1 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 --> v1:10.20.193.119:6800/4283496532 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3278083790 con 0x7f3278061a90 2026-02-13T08:14:05.349 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 20 client.104204.objecter dump_active .. 0 homeless 2026-02-13T08:14:05.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_get_version_reply(handle=1 version=323) ==== 24+0+0 (unknown 3751641255 0 0) 0x7f329c04aa30 con 0x7f32a8052360 2026-02-13T08:14:05.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 10 monclient: handle_get_version_reply finishing 1 version 323 2026-02-13T08:14:05.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f32ae117640 10 monclient: get_auth_request con 0x7f327803ba90 auth_method 0 2026-02-13T08:14:05.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f32ae918640 10 monclient: get_auth_request con 0x7f3278061a90 auth_method 0 2026-02-13T08:14:05.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 10 client.104204.objecter ms_handle_connect 0x7f327803ba90 2026-02-13T08:14:05.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 10 client.104204.objecter ms_handle_connect 0x7f3278061a90 2026-02-13T08:14:05.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== osd.3 v1:10.20.193.119:6800/4283496532 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f3278083790 con 0x7f3278061a90 2026-02-13T08:14:05.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 10 client.104204.objecter ms_dispatch2 0x7f32a8000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:14:05.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 10 client.104204.objecter _finish_command 1 = system:0 2026-02-13T08:14:05.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 20 client.104204.objecter put_session s=0x7f32780613e0 osd=3 4 2026-02-13T08:14:05.350 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.320+0000 7f328effd640 15 client.104204.objecter _session_command_op_remove 3 1 2026-02-13T08:14:05.351 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 10 client.104204.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-13T08:14:05.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 15 client.104204.objecter _session_command_op_assign -1 2 2026-02-13T08:14:05.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 20 client.104204.objecter _get_session s=0x7f32780613e0 osd=3 3 2026-02-13T08:14:05.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 20 client.104204.objecter put_session s=0x7f32780613e0 osd=3 3 2026-02-13T08:14:05.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 20 client.104204.objecter _get_session s=0x7f32780613e0 osd=3 3 2026-02-13T08:14:05.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 15 client.104204.objecter _session_command_op_remove -1 2 2026-02-13T08:14:05.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 20 client.104204.objecter get_session s=0x7f32780613e0 osd=3 3 2026-02-13T08:14:05.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 15 client.104204.objecter _session_command_op_assign 3 2 2026-02-13T08:14:05.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 20 client.104204.objecter put_session s=0x7f32780613e0 osd=3 4 2026-02-13T08:14:05.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 10 client.104204.objecter _send_command 2 2026-02-13T08:14:05.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 1 -- 10.20.193.104:0/533621735 --> v1:10.20.193.119:6800/4283496532 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3274002af0 con 0x7f3278061a90 2026-02-13T08:14:05.352 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f328effd640 1 -- 10.20.193.104:0/533621735 <== osd.3 v1:10.20.193.119:6800/4283496532 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f3274002af0 con 0x7f3278061a90 2026-02-13T08:14:05.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f328effd640 10 client.104204.objecter ms_dispatch2 0x7f32a8000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:14:05.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f328effd640 10 client.104204.objecter _finish_command 2 = system:0 2026-02-13T08:14:05.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f328effd640 20 client.104204.objecter put_session s=0x7f32780613e0 osd=3 4 2026-02-13T08:14:05.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f328effd640 15 client.104204.objecter _session_command_op_remove 3 2 2026-02-13T08:14:05.353 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:14:05.353 INFO:teuthology.orchestra.run.trial104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T08:14:05.353 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:14:05.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 10 librados: watch_flush enter 2026-02-13T08:14:05.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 10 librados: watch_flush exit 2026-02-13T08:14:05.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 10 client.104204.objecter close_session for osd.3 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 1 -- 10.20.193.104:0/533621735 >> v1:10.20.193.119:6800/4283496532 conn(0x7f3278061a90 legacy=0x7f3278081f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 20 client.104204.objecter put_session s=0x7f32780613e0 osd=3 1 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 20 client.104204.objecter shutdown clearing up homeless session... 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 10 client.104204.objecter successfully canceled tick 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 1 -- 10.20.193.104:0/533621735 >> v1:10.20.193.119:6812/276487904 conn(0x7f327803ba90 legacy=0x7f327805bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 10 monclient: shutdown 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 1 -- 10.20.193.104:0/533621735 >> v1:10.20.193.104:6790/0 conn(0x7f32a8052360 legacy=0x7f32a812aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32ae918640 1 -- 10.20.193.104:0/533621735 reap_dead start 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 1 -- 10.20.193.104:0/533621735 shutdown_connections 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 1 -- 10.20.193.104:0/533621735 >> 10.20.193.104:0/533621735 conn(0x7f32a808d6c0 msgr2=0x7f32a808fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 1 -- 10.20.193.104:0/533621735 shutdown_connections 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 1 -- 10.20.193.104:0/533621735 wait complete. 2026-02-13T08:14:05.356 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.328+0000 7f32b03a2640 1 librados: shutdown 2026-02-13T08:14:05.357 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-13T08:14:05.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient: get_monmap_and_config 2026-02-13T08:14:05.425 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.426 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient: monmap: 2026-02-13T08:14:05.426 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.426 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.426 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:05.422246+0000 2026-02-13T08:14:05.426 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:05.422246+0000 2026-02-13T08:14:05.426 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.426 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.426 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.426 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:05.426 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:05.427 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 1 Processor -- start 2026-02-13T08:14:05.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 1 -- start start 2026-02-13T08:14:05.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient: init 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient(hunting): picked mon.noname-c con 0x7f7574139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient(hunting): picked mon.noname-a con 0x7f757415e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient(hunting): picked mon.noname-b con 0x7f757417fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757413aa00 con 0x7f757415e200 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757408ba20 con 0x7f7574139f20 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7574089e30 con 0x7f757417fd00 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient(hunting): authenticate will time out at 951.011038s 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f7572ffd640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f757415e200 0x7f757417e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:45106/0 (socket says 10.20.193.104:45106) 2026-02-13T08:14:05.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f7573fff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f757417fd00 0x7f75741a00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57856/0 (socket says 10.20.193.104:57856) 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f7572ffd640 1 -- 10.20.193.104:0/1849444239 learned_addr learned my addr 10.20.193.104:0/1849444239 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3866975273 0 0) 0x7f7574089e30 con 0x7f757417fd00 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): my global_id is 104207 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7558003620 con 0x7f757417fd00 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586727116 0 0) 0x7f7564002850 con 0x7f757415e200 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): my global_id is 94296 2026-02-13T08:14:05.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7574089e30 con 0x7f757415e200 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088270247 0 0) 0x7f757408ba20 con 0x7f7574139f20 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient(hunting): my global_id is 74752 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7564002850 con 0x7f7574139f20 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1893095335 0 0) 0x7f7558003620 con 0x7f757417fd00 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 >> v1:10.20.193.119:6789/0 conn(0x7f7574139f20 legacy=0x7f757413a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 >> v1:10.20.193.104:6789/0 conn(0x7f757415e200 legacy=0x7f757417e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 monclient: found mon.noname-b 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.437 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757408a380 con 0x7f757417fd00 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7568003180 con 0x7f757417fd00 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient: dump: 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.438 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 5 monclient: authenticate success, global_id 104207 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f75680033d0 con 0x7f757417fd00 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 1 -- 10.20.193.104:0/1849444239 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f75680037e0 con 0x7f757417fd00 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.439 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f75727fc640 10 monclient: dump: 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.416+0000 7f757a250640 4 set_mon_vals no callback set 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: shutdown 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- 10.20.193.104:0/1849444239 >> v1:10.20.193.104:6790/0 conn(0x7f757417fd00 legacy=0x7f75741a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- 10.20.193.104:0/1849444239 shutdown_connections 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- 10.20.193.104:0/1849444239 >> 10.20.193.104:0/1849444239 conn(0x7f7574051a50 msgr2=0x7f7574051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- 10.20.193.104:0/1849444239 shutdown_connections 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- 10.20.193.104:0/1849444239 wait complete. 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: monmap: 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:05.441 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 librados: starting msgr at 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 librados: starting objecter 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 Processor -- start 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- start start 2026-02-13T08:14:05.442 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 librados: setting wanted keys 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 librados: calling monclient init 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: init 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient(hunting): picked mon.noname-c con 0x7f7574139f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient(hunting): picked mon.noname-a con 0x7f757415e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient(hunting): picked mon.noname-b con 0x7f757417fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75741640e0 con 0x7f757415e200 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7574162600 con 0x7f757417fd00 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f757417edf0 con 0x7f7574139f20 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient(hunting): authenticate will time out at 951.013512s 2026-02-13T08:14:05.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f7572ffd640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f757415e200 0x7f757417e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:45112/0 (socket says 10.20.193.104:45112) 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f7572ffd640 1 -- 10.20.193.104:0/1216305135 learned_addr learned my addr 10.20.193.104:0/1216305135 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f75737fe640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f7574139f20 0x7f757417dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:57864/0 (socket says 10.20.193.104:57864) 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 client.?.objecter ms_handle_connect 0x7f757415e200 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 client.?.objecter ms_handle_connect 0x7f7574139f20 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1645606237 0 0) 0x7f757417edf0 con 0x7f7574139f20 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): my global_id is 104210 2026-02-13T08:14:05.444 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7544003620 con 0x7f7574139f20 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2575840174 0 0) 0x7f75741640e0 con 0x7f757415e200 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): my global_id is 94299 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f757417edf0 con 0x7f757415e200 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3310801199 0 0) 0x7f7544003620 con 0x7f7574139f20 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f75741640e0 con 0x7f7574139f20 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f75600030c0 con 0x7f7574139f20 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): dump: 2026-02-13T08:14:05.445 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3744052177 0 0) 0x7f757417edf0 con 0x7f757415e200 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7544003620 con 0x7f757415e200 2026-02-13T08:14:05.446 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7564003130 con 0x7f757415e200 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient(hunting): dump: 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.447 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 client.?.objecter ms_handle_connect 0x7f757417fd00 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2176033886 0 0) 0x7f75741640e0 con 0x7f7574139f20 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 >> v1:10.20.193.119:6789/0 conn(0x7f757417fd00 legacy=0x7f7574126aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 >> v1:10.20.193.104:6789/0 conn(0x7f757415e200 legacy=0x7f757417e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 monclient: found mon.c 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7574162bf0 con 0x7f7574139f20 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 5 monclient: authenticate success, global_id 104210 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: _renew_subs 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- 10.20.193.104:0/1216305135 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7574164f50 con 0x7f7574139f20 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 client.104210.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: _renew_subs 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- 10.20.193.104:0/1216305135 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7574163750 con 0x7f7574139f20 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 librados: init done 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7560003470 con 0x7f7574139f20 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.449 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f7560003b60 con 0x7f7574139f20 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f7571ffb640 4 set_mon_vals no callback set 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 monclient: dump: 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.450 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f757a250640 1 -- 10.20.193.104:0/1216305135 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75741647c0 con 0x7f7574139f20 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f7560003d00 con 0x7f7574139f20 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f756004a550 con 0x7f7574139f20 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 client.104210.objecter ms_dispatch2 0x7f7574000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 3 client.104210.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 3 client.104210.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 20 client.104210.objecter dump_active .. 0 homeless 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f7572ffd640 10 monclient: get_auth_request con 0x7f754403b7a0 auth_method 0 2026-02-13T08:14:05.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.420+0000 7f754ffff640 10 client.104210.objecter ms_handle_connect 0x7f754403b7a0 2026-02-13T08:14:05.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.424+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f7560016c70 con 0x7f7574139f20 2026-02-13T08:14:05.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.424+0000 7f754ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.452 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.424+0000 7f754ffff640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:05.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.504+0000 7f757a250640 1 -- 10.20.193.104:0/1216305135 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f75740380f0 con 0x7f754403b7a0 2026-02-13T08:14:05.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f754ffff640 1 -- 10.20.193.104:0/1216305135 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f75740380f0 con 0x7f754403b7a0 2026-02-13T08:14:05.515 INFO:teuthology.orchestra.run.trial104.stderr:instructed osd(s) 3 to deep-scrub 2026-02-13T08:14:05.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 10 librados: watch_flush enter 2026-02-13T08:14:05.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 10 librados: watch_flush exit 2026-02-13T08:14:05.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 20 client.104210.objecter shutdown clearing up homeless session... 2026-02-13T08:14:05.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 10 client.104210.objecter successfully canceled tick 2026-02-13T08:14:05.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 1 -- 10.20.193.104:0/1216305135 >> v1:10.20.193.119:6812/276487904 conn(0x7f754403b7a0 legacy=0x7f754405bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 10 monclient: shutdown 2026-02-13T08:14:05.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 1 -- 10.20.193.104:0/1216305135 >> v1:10.20.193.104:6790/0 conn(0x7f7574139f20 legacy=0x7f757417dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 1 -- 10.20.193.104:0/1216305135 shutdown_connections 2026-02-13T08:14:05.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 1 -- 10.20.193.104:0/1216305135 >> 10.20.193.104:0/1216305135 conn(0x7f7574051a50 msgr2=0x7f757405bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 1 -- 10.20.193.104:0/1216305135 shutdown_connections 2026-02-13T08:14:05.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 1 -- 10.20.193.104:0/1216305135 wait complete. 2026-02-13T08:14:05.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.508+0000 7f757a250640 1 librados: shutdown 2026-02-13T08:14:05.526 INFO:tasks.ceph:Scrubbing osd.4 2026-02-13T08:14:05.526 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-13T08:14:05.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: get_monmap_and_config 2026-02-13T08:14:05.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: monmap: 2026-02-13T08:14:05.596 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.596 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.596 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:05.592501+0000 2026-02-13T08:14:05.596 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:05.592501+0000 2026-02-13T08:14:05.596 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.596 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.597 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.597 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:05.597 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:05.597 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 Processor -- start 2026-02-13T08:14:05.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- start start 2026-02-13T08:14:05.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: init 2026-02-13T08:14:05.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:05.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient(hunting): picked mon.noname-c con 0x7f66d405d1d0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient(hunting): picked mon.noname-b con 0x7f66d4160340 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient(hunting): picked mon.noname-a con 0x7f66d4181e40 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d408b500 con 0x7f66d4181e40 2026-02-13T08:14:05.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d408b7e0 con 0x7f66d405d1d0 2026-02-13T08:14:05.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d408bac0 con 0x7f66d4160340 2026-02-13T08:14:05.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient(hunting): authenticate will time out at 951.181261s 2026-02-13T08:14:05.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d2d76640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f66d4181e40 0x7f66d41a2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44128/0 (socket says 10.20.193.104:44128) 2026-02-13T08:14:05.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d2d76640 1 -- 10.20.193.104:0/1041454092 learned_addr learned my addr 10.20.193.104:0/1041454092 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 -- 10.20.193.104:0/1041454092 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568870929 0 0) 0x7f66d408bac0 con 0x7f66d4160340 2026-02-13T08:14:05.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient(hunting): my global_id is 104213 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 -- 10.20.193.104:0/1041454092 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66c0003620 con 0x7f66d4160340 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 -- 10.20.193.104:0/1041454092 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3598633650 0 0) 0x7f66d408b500 con 0x7f66d4181e40 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient(hunting): my global_id is 94302 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 -- 10.20.193.104:0/1041454092 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66d408bac0 con 0x7f66d4181e40 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 -- 10.20.193.104:0/1041454092 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3070678488 0 0) 0x7f66c0003620 con 0x7f66d4160340 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 -- 10.20.193.104:0/1041454092 >> v1:10.20.193.119:6789/0 conn(0x7f66d405d1d0 legacy=0x7f66d405d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 -- 10.20.193.104:0/1041454092 >> v1:10.20.193.104:6789/0 conn(0x7f66d4181e40 legacy=0x7f66d41a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 monclient: found mon.noname-b 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 -- 10.20.193.104:0/1041454092 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d408a1a0 con 0x7f66d4160340 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 -- 10.20.193.104:0/1041454092 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f66bc002e00 con 0x7f66d4160340 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 5 monclient: authenticate success, global_id 104213 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:05.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient: dump: 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.609 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 -- 10.20.193.104:0/1041454092 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66bc0030c0 con 0x7f66d4160340 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 1 -- 10.20.193.104:0/1041454092 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f66bc003500 con 0x7f66d4160340 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 4 set_mon_vals no callback set 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1573640 10 monclient: dump: 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.610 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: shutdown 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- 10.20.193.104:0/1041454092 >> v1:10.20.193.104:6790/0 conn(0x7f66d4160340 legacy=0x7f66d4180720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- 10.20.193.104:0/1041454092 shutdown_connections 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- 10.20.193.104:0/1041454092 >> 10.20.193.104:0/1041454092 conn(0x7f66d408d6c0 msgr2=0x7f66d408dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- 10.20.193.104:0/1041454092 shutdown_connections 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- 10.20.193.104:0/1041454092 wait complete. 2026-02-13T08:14:05.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: monmap: 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 librados: starting msgr at 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 librados: starting objecter 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 Processor -- start 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- start start 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 librados: setting wanted keys 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 librados: calling monclient init 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: init 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient(hunting): picked mon.noname-b con 0x7f66d405d1d0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient(hunting): picked mon.noname-c con 0x7f66d4160340 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient(hunting): picked mon.noname-a con 0x7f66d4181e40 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d4167fb0 con 0x7f66d4181e40 2026-02-13T08:14:05.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d4164fb0 con 0x7f66d405d1d0 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d40865b0 con 0x7f66d4160340 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient(hunting): authenticate will time out at 951.183199s 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1d74640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f66d4160340 0x7f66d41648a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47930/0 (socket says 10.20.193.104:47930) 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d1d74640 1 -- 10.20.193.104:0/2584204186 learned_addr learned my addr 10.20.193.104:0/2584204186 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 client.?.objecter ms_handle_connect 0x7f66d4160340 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 client.?.objecter ms_handle_connect 0x7f66d4181e40 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1646531154 0 0) 0x7f66d40865b0 con 0x7f66d4160340 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): my global_id is 104216 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66a0003620 con 0x7f66d4160340 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715089995 0 0) 0x7f66d4167fb0 con 0x7f66d4181e40 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): my global_id is 94305 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66d40865b0 con 0x7f66d4181e40 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1624634901 0 0) 0x7f66a0003620 con 0x7f66d4160340 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66d4167fb0 con 0x7f66d4160340 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 client.?.objecter ms_handle_connect 0x7f66d405d1d0 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f66bc002dc0 con 0x7f66d4160340 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): dump: 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.616 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2458986389 0 0) 0x7f66d40865b0 con 0x7f66d4181e40 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66a0003620 con 0x7f66d4181e40 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f66c4003330 con 0x7f66d4181e40 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient(hunting): dump: 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.617 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4081399422 0 0) 0x7f66d4167fb0 con 0x7f66d4160340 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 >> v1:10.20.193.119:6789/0 conn(0x7f66d405d1d0 legacy=0x7f66d4164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 >> v1:10.20.193.104:6789/0 conn(0x7f66d4181e40 legacy=0x7f66d4127a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 monclient: found mon.c 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d4167140 con 0x7f66d4160340 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 5 monclient: authenticate success, global_id 104216 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: _renew_subs 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- 10.20.193.104:0/2584204186 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f66d4165c50 con 0x7f66d4160340 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 client.104216.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: _renew_subs 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- 10.20.193.104:0/2584204186 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f66d4181b60 con 0x7f66d4160340 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 librados: init done 2026-02-13T08:14:05.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66bc002fd0 con 0x7f66d4160340 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f66bc003c00 con 0x7f66d4160340 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66baffd640 10 monclient: dump: 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.620 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d0d72640 4 set_mon_vals no callback set 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 client.104216.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 15 client.104216.objecter _session_command_op_assign -1 1 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 20 client.104216.objecter _get_session osd=-1 returning homeless 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 client.104216.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.588+0000 7f66d8807640 1 -- 10.20.193.104:0/2584204186 --> v1:10.20.193.104:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f66d408a460 con 0x7f66d4160340 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f66bc003da0 con 0x7f66d4160340 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f66bc04a460 con 0x7f66d4160340 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 10 client.104216.objecter ms_dispatch2 0x7f66d4000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:05.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 3 client.104216.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 3 client.104216.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 10 client.104216.objecter checking command 1 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 20 client.104216.objecter _get_session s=0x7f66a0061140 osd=4 3 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 20 client.104216.objecter put_session s=0x7f66a0061140 osd=4 3 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 15 client.104216.objecter _session_command_op_remove -1 1 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 20 client.104216.objecter _get_session s=0x7f66a0061140 osd=4 3 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 20 client.104216.objecter get_session s=0x7f66a0061140 osd=4 3 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 15 client.104216.objecter _session_command_op_assign 4 1 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 20 client.104216.objecter put_session s=0x7f66a0061140 osd=4 4 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 10 client.104216.objecter _send_command 1 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 --> v1:10.20.193.119:6808/1543069880 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66a00834f0 con 0x7f66a00617f0 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 20 client.104216.objecter dump_active .. 0 homeless 2026-02-13T08:14:05.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_get_version_reply(handle=1 version=323) ==== 24+0+0 (unknown 3751641255 0 0) 0x7f66bc04a880 con 0x7f66d4160340 2026-02-13T08:14:05.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 10 monclient: handle_get_version_reply finishing 1 version 323 2026-02-13T08:14:05.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66d2575640 10 monclient: get_auth_request con 0x7f66a003b8d0 auth_method 0 2026-02-13T08:14:05.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 10 client.104216.objecter ms_handle_connect 0x7f66a003b8d0 2026-02-13T08:14:05.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66d2d76640 10 monclient: get_auth_request con 0x7f66a00617f0 auth_method 0 2026-02-13T08:14:05.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 10 client.104216.objecter ms_handle_connect 0x7f66a00617f0 2026-02-13T08:14:05.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== osd.4 v1:10.20.193.119:6808/1543069880 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7f66a00834f0 con 0x7f66a00617f0 2026-02-13T08:14:05.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 10 client.104216.objecter ms_dispatch2 0x7f66d4000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:14:05.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 10 client.104216.objecter _finish_command 1 = system:0 2026-02-13T08:14:05.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 20 client.104216.objecter put_session s=0x7f66a0061140 osd=4 4 2026-02-13T08:14:05.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.592+0000 7f66baffd640 15 client.104216.objecter _session_command_op_remove 4 1 2026-02-13T08:14:05.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 10 client.104216.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-13T08:14:05.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 15 client.104216.objecter _session_command_op_assign -1 2 2026-02-13T08:14:05.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 20 client.104216.objecter _get_session s=0x7f66a0061140 osd=4 3 2026-02-13T08:14:05.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 20 client.104216.objecter put_session s=0x7f66a0061140 osd=4 3 2026-02-13T08:14:05.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 20 client.104216.objecter _get_session s=0x7f66a0061140 osd=4 3 2026-02-13T08:14:05.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 15 client.104216.objecter _session_command_op_remove -1 2 2026-02-13T08:14:05.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 20 client.104216.objecter get_session s=0x7f66a0061140 osd=4 3 2026-02-13T08:14:05.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 15 client.104216.objecter _session_command_op_assign 4 2 2026-02-13T08:14:05.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 20 client.104216.objecter put_session s=0x7f66a0061140 osd=4 4 2026-02-13T08:14:05.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 10 client.104216.objecter _send_command 2 2026-02-13T08:14:05.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 1 -- 10.20.193.104:0/2584204186 --> v1:10.20.193.119:6808/1543069880 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f66d4166a00 con 0x7f66a00617f0 2026-02-13T08:14:05.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66baffd640 1 -- 10.20.193.104:0/2584204186 <== osd.4 v1:10.20.193.119:6808/1543069880 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f66d4166a00 con 0x7f66a00617f0 2026-02-13T08:14:05.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66baffd640 10 client.104216.objecter ms_dispatch2 0x7f66d4000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:14:05.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66baffd640 10 client.104216.objecter _finish_command 2 = system:0 2026-02-13T08:14:05.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66baffd640 20 client.104216.objecter put_session s=0x7f66a0061140 osd=4 4 2026-02-13T08:14:05.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66baffd640 15 client.104216.objecter _session_command_op_remove 4 2 2026-02-13T08:14:05.626 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:14:05.626 INFO:teuthology.orchestra.run.trial104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T08:14:05.626 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:14:05.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 10 librados: watch_flush enter 2026-02-13T08:14:05.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 10 librados: watch_flush exit 2026-02-13T08:14:05.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 10 client.104216.objecter close_session for osd.4 2026-02-13T08:14:05.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 1 -- 10.20.193.104:0/2584204186 >> v1:10.20.193.119:6808/1543069880 conn(0x7f66a00617f0 legacy=0x7f66a0081c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 20 client.104216.objecter put_session s=0x7f66a0061140 osd=4 1 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 20 client.104216.objecter shutdown clearing up homeless session... 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 10 client.104216.objecter successfully canceled tick 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 1 -- 10.20.193.104:0/2584204186 >> v1:10.20.193.119:6812/276487904 conn(0x7f66a003b8d0 legacy=0x7f66a005bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 10 monclient: shutdown 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 1 -- 10.20.193.104:0/2584204186 >> v1:10.20.193.104:6790/0 conn(0x7f66d4160340 legacy=0x7f66d41648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d2d76640 1 -- 10.20.193.104:0/2584204186 reap_dead start 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 1 -- 10.20.193.104:0/2584204186 shutdown_connections 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 1 -- 10.20.193.104:0/2584204186 >> 10.20.193.104:0/2584204186 conn(0x7f66d408d6c0 msgr2=0x7f66d413de70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 1 -- 10.20.193.104:0/2584204186 shutdown_connections 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 1 -- 10.20.193.104:0/2584204186 wait complete. 2026-02-13T08:14:05.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.600+0000 7f66d8807640 1 librados: shutdown 2026-02-13T08:14:05.630 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-13T08:14:05.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 10 monclient: get_monmap_and_config 2026-02-13T08:14:05.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.698 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 10 monclient: monmap: 2026-02-13T08:14:05.698 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.699 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.699 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:05.695007+0000 2026-02-13T08:14:05.699 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:05.695007+0000 2026-02-13T08:14:05.699 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.699 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.699 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.699 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:05.699 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:05.699 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 1 Processor -- start 2026-02-13T08:14:05.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 1 -- start start 2026-02-13T08:14:05.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 10 monclient: init 2026-02-13T08:14:05.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:14:05.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 10 monclient(hunting): picked mon.noname-a con 0x7fd0a813ef60 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 10 monclient(hunting): picked mon.noname-b con 0x7fd0a813f330 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 10 monclient(hunting): picked mon.noname-c con 0x7fd0a81819c0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a813fe80 con 0x7fd0a813ef60 2026-02-13T08:14:05.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a805d8f0 con 0x7fd0a81819c0 2026-02-13T08:14:05.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a805e160 con 0x7fd0a813f330 2026-02-13T08:14:05.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0af758640 10 monclient(hunting): authenticate will time out at 951.283935s 2026-02-13T08:14:05.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0ad4cd640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fd0a813ef60 0x7fd0a808c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44142/0 (socket says 10.20.193.104:44142) 2026-02-13T08:14:05.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.688+0000 7fd0ad4cd640 1 -- 10.20.193.104:0/3539961769 learned_addr learned my addr 10.20.193.104:0/3539961769 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 -- 10.20.193.104:0/3539961769 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2504453989 0 0) 0x7fd0a805e160 con 0x7fd0a813f330 2026-02-13T08:14:05.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient(hunting): my global_id is 104219 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 -- 10.20.193.104:0/3539961769 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd090003620 con 0x7fd0a813f330 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 -- 10.20.193.104:0/3539961769 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731700879 0 0) 0x7fd0a813fe80 con 0x7fd0a813ef60 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient(hunting): my global_id is 94308 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 -- 10.20.193.104:0/3539961769 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0a805e160 con 0x7fd0a813ef60 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 -- 10.20.193.104:0/3539961769 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3708896159 0 0) 0x7fd090003620 con 0x7fd0a813f330 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 -- 10.20.193.104:0/3539961769 >> v1:10.20.193.119:6789/0 conn(0x7fd0a81819c0 legacy=0x7fd0a81a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 -- 10.20.193.104:0/3539961769 >> v1:10.20.193.104:6789/0 conn(0x7fd0a813ef60 legacy=0x7fd0a808c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 monclient: found mon.noname-b 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 -- 10.20.193.104:0/3539961769 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a805d390 con 0x7fd0a813f330 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 -- 10.20.193.104:0/3539961769 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd09c002e00 con 0x7fd0a813f330 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient: dump: 2026-02-13T08:14:05.712 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 5 monclient: authenticate success, global_id 104219 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:05.713 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 -- 10.20.193.104:0/3539961769 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd09c0030c0 con 0x7fd0a813f330 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 1 -- 10.20.193.104:0/3539961769 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd09c003500 con 0x7fd0a813f330 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd097fff640 10 monclient: dump: 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.714 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 4 set_mon_vals no callback set 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: shutdown 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- 10.20.193.104:0/3539961769 >> v1:10.20.193.104:6790/0 conn(0x7fd0a813f330 legacy=0x7fd0a81802a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- 10.20.193.104:0/3539961769 shutdown_connections 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- 10.20.193.104:0/3539961769 >> 10.20.193.104:0/3539961769 conn(0x7fd0a808d040 msgr2=0x7fd0a808d410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- 10.20.193.104:0/3539961769 shutdown_connections 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- 10.20.193.104:0/3539961769 wait complete. 2026-02-13T08:14:05.715 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: monmap: 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.716 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 librados: starting msgr at 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 librados: starting objecter 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 Processor -- start 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- start start 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 librados: setting wanted keys 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 librados: calling monclient init 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: init 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient(hunting): picked mon.noname-b con 0x7fd0a813ef60 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient(hunting): picked mon.noname-a con 0x7fd0a813f330 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient(hunting): picked mon.noname-c con 0x7fd0a81819c0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a807a940 con 0x7fd0a813f330 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a8078200 con 0x7fd0a813ef60 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a808a500 con 0x7fd0a81819c0 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient(hunting): authenticate will time out at 951.285588s 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0adcce640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fd0a81819c0 0x7fd0a8180eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47946/0 (socket says 10.20.193.104:47946) 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0adcce640 1 -- 10.20.193.104:0/1042506405 learned_addr learned my addr 10.20.193.104:0/1042506405 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0acccc640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fd0a813f330 0x7fd0a8077af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44158/0 (socket says 10.20.193.104:44158) 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 client.?.objecter ms_handle_connect 0x7fd0a81819c0 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 client.?.objecter ms_handle_connect 0x7fd0a813f330 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141449584 0 0) 0x7fd0a808a500 con 0x7fd0a81819c0 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): my global_id is 104222 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd078003620 con 0x7fd0a81819c0 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783331160 0 0) 0x7fd0a807a940 con 0x7fd0a813f330 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): my global_id is 94311 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0a808a500 con 0x7fd0a813f330 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3396161880 0 0) 0x7fd078003620 con 0x7fd0a81819c0 2026-02-13T08:14:05.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0a807a940 con 0x7fd0a81819c0 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd0a4003470 con 0x7fd0a81819c0 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): dump: 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.720 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 520796580 0 0) 0x7fd0a808a500 con 0x7fd0a813f330 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd078003620 con 0x7fd0a813f330 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 client.?.objecter ms_handle_connect 0x7fd0a813ef60 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd09c002dc0 con 0x7fd0a813f330 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient(hunting): dump: 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.721 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.2 v1:10.20.193.104:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4120943652 0 0) 0x7fd0a807a940 con 0x7fd0a81819c0 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 >> v1:10.20.193.119:6789/0 conn(0x7fd0a813ef60 legacy=0x7fd0a80773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 >> v1:10.20.193.104:6789/0 conn(0x7fd0a813f330 legacy=0x7fd0a8077af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 monclient: found mon.c 2026-02-13T08:14:05.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a8055f30 con 0x7fd0a81819c0 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 5 monclient: authenticate success, global_id 104222 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: _renew_subs 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- 10.20.193.104:0/1042506405 --> v1:10.20.193.104:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a8079ad0 con 0x7fd0a81819c0 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 client.104222.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: _renew_subs 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- 10.20.193.104:0/1042506405 --> v1:10.20.193.104:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0a8087250 con 0x7fd0a81819c0 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 librados: init done 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.2 v1:10.20.193.104:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0a4003820 con 0x7fd0a81819c0 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.2 v1:10.20.193.104:6790/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fd0a4003ee0 con 0x7fd0a81819c0 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0977fe640 4 set_mon_vals no callback set 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 monclient: dump: 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.724 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 10 monclient: _send_mon_message to mon.c at v1:10.20.193.104:6790/0 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0af758640 1 -- 10.20.193.104:0/1042506405 --> v1:10.20.193.104:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a8061860 con 0x7fd0a81819c0 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.2 v1:10.20.193.104:6790/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fd0a4004080 con 0x7fd0a81819c0 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.2 v1:10.20.193.104:6790/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7fd0a404a8a0 con 0x7fd0a81819c0 2026-02-13T08:14:05.725 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 client.104222.objecter ms_dispatch2 0x7fd0a8000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:05.726 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 3 client.104222.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:05.726 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 3 client.104222.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:05.726 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 20 client.104222.objecter dump_active .. 0 homeless 2026-02-13T08:14:05.726 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd0ad4cd640 10 monclient: get_auth_request con 0x7fd07803b7d0 auth_method 0 2026-02-13T08:14:05.726 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.692+0000 7fd095ffb640 10 client.104222.objecter ms_handle_connect 0x7fd07803b7d0 2026-02-13T08:14:05.726 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.696+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mon.2 v1:10.20.193.104:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7fd0a4016fc0 con 0x7fd0a81819c0 2026-02-13T08:14:05.726 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.696+0000 7fd095ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.726 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.696+0000 7fd095ffb640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:05.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 1 -- 10.20.193.104:0/1042506405 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fd0a80793a0 con 0x7fd07803b7d0 2026-02-13T08:14:05.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd095ffb640 1 -- 10.20.193.104:0/1042506405 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7fd0a80793a0 con 0x7fd07803b7d0 2026-02-13T08:14:05.788 INFO:teuthology.orchestra.run.trial104.stderr:instructed osd(s) 4 to deep-scrub 2026-02-13T08:14:05.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 10 librados: watch_flush enter 2026-02-13T08:14:05.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 10 librados: watch_flush exit 2026-02-13T08:14:05.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 20 client.104222.objecter shutdown clearing up homeless session... 2026-02-13T08:14:05.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 10 client.104222.objecter successfully canceled tick 2026-02-13T08:14:05.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 1 -- 10.20.193.104:0/1042506405 >> v1:10.20.193.119:6812/276487904 conn(0x7fd07803b7d0 legacy=0x7fd07805bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 10 monclient: shutdown 2026-02-13T08:14:05.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 1 -- 10.20.193.104:0/1042506405 >> v1:10.20.193.104:6790/0 conn(0x7fd0a81819c0 legacy=0x7fd0a8180eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 1 -- 10.20.193.104:0/1042506405 shutdown_connections 2026-02-13T08:14:05.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 1 -- 10.20.193.104:0/1042506405 >> 10.20.193.104:0/1042506405 conn(0x7fd0a808d040 msgr2=0x7fd0a808e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 1 -- 10.20.193.104:0/1042506405 shutdown_connections 2026-02-13T08:14:05.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 1 -- 10.20.193.104:0/1042506405 wait complete. 2026-02-13T08:14:05.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.780+0000 7fd0af758640 1 librados: shutdown 2026-02-13T08:14:05.798 INFO:tasks.ceph:Scrubbing osd.5 2026-02-13T08:14:05.798 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-13T08:14:05.859 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.848+0000 7fcde9ee8640 10 monclient: get_monmap_and_config 2026-02-13T08:14:05.859 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.848+0000 7fcde9ee8640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.859 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.848+0000 7fcde9ee8640 10 monclient: monmap: 2026-02-13T08:14:05.859 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.859 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.859 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:05.855784+0000 2026-02-13T08:14:05.860 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:05.855784+0000 2026-02-13T08:14:05.860 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.860 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.860 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.860 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:05.860 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:05.860 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 Processor -- start 2026-02-13T08:14:05.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- start start 2026-02-13T08:14:05.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: init 2026-02-13T08:14:05.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:05.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient(hunting): picked mon.noname-c con 0x7fcde405d1d0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient(hunting): picked mon.noname-b con 0x7fcde4160340 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.868 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient(hunting): picked mon.noname-a con 0x7fcde4181e40 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde408b500 con 0x7fcde4181e40 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde408b7e0 con 0x7fcde405d1d0 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde408bac0 con 0x7fcde4160340 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient(hunting): authenticate will time out at 951.444512s 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde3fff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fcde4181e40 0x7fcde41a2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44160/0 (socket says 10.20.193.104:44160) 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde3fff640 1 -- 10.20.193.104:0/1798197525 learned_addr learned my addr 10.20.193.104:0/1798197525 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde2ffd640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fcde4160340 0x7fcde4180720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47952/0 (socket says 10.20.193.104:47952) 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 -- 10.20.193.104:0/1798197525 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946219947 0 0) 0x7fcde408b500 con 0x7fcde4181e40 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.869 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient(hunting): my global_id is 94314 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 -- 10.20.193.104:0/1798197525 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdc8003620 con 0x7fcde4181e40 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 -- 10.20.193.104:0/1798197525 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372650061 0 0) 0x7fcde408bac0 con 0x7fcde4160340 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient(hunting): my global_id is 104225 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 -- 10.20.193.104:0/1798197525 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcde408b500 con 0x7fcde4160340 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 -- 10.20.193.104:0/1798197525 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3273105728 0 0) 0x7fcdc8003620 con 0x7fcde4181e40 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 -- 10.20.193.104:0/1798197525 >> v1:10.20.193.104:6790/0 conn(0x7fcde4160340 legacy=0x7fcde4180720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 -- 10.20.193.104:0/1798197525 >> v1:10.20.193.119:6789/0 conn(0x7fcde405d1d0 legacy=0x7fcde405d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:14:05.870 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 monclient: found mon.noname-a 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 -- 10.20.193.104:0/1798197525 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde408a1a0 con 0x7fcde4181e40 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 -- 10.20.193.104:0/1798197525 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fcdd8003180 con 0x7fcde4181e40 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient: dump: 2026-02-13T08:14:05.871 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 5 monclient: authenticate success, global_id 94314 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:05.872 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 -- 10.20.193.104:0/1798197525 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcdd8003480 con 0x7fcde4181e40 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 1 -- 10.20.193.104:0/1798197525 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fcdd80038c0 con 0x7fcde4181e40 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde27fc640 10 monclient: dump: 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.873 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 4 set_mon_vals no callback set 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: shutdown 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1798197525 >> v1:10.20.193.104:6789/0 conn(0x7fcde4181e40 legacy=0x7fcde41a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1798197525 shutdown_connections 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1798197525 >> 10.20.193.104:0/1798197525 conn(0x7fcde408d6c0 msgr2=0x7fcde408dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1798197525 shutdown_connections 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1798197525 wait complete. 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: monmap: 2026-02-13T08:14:05.875 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.875 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:05.875 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:05.875 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:05.875 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.875 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.875 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.875 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:05.875 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:05.875 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.875 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 librados: starting msgr at 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 librados: starting objecter 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 Processor -- start 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- start start 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 librados: setting wanted keys 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 librados: calling monclient init 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: init 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient(hunting): picked mon.noname-b con 0x7fcde405d1d0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient(hunting): picked mon.noname-c con 0x7fcde4160340 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient(hunting): picked mon.noname-a con 0x7fcde4181e40 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde41681c0 con 0x7fcde4181e40 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde41652b0 con 0x7fcde405d1d0 2026-02-13T08:14:05.876 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde40865b0 con 0x7fcde4160340 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient(hunting): authenticate will time out at 951.446394s 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde3fff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fcde4181e40 0x7fcde4127a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44168/0 (socket says 10.20.193.104:44168) 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde3fff640 1 -- 10.20.193.104:0/1437658295 learned_addr learned my addr 10.20.193.104:0/1437658295 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 client.?.objecter ms_handle_connect 0x7fcde4181e40 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 client.?.objecter ms_handle_connect 0x7fcde4160340 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 401790248 0 0) 0x7fcde41681c0 con 0x7fcde4181e40 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.877 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): my global_id is 94317 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdb4003620 con 0x7fcde4181e40 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 341908760 0 0) 0x7fcde40865b0 con 0x7fcde4160340 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): my global_id is 104228 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcde41681c0 con 0x7fcde4160340 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2278936848 0 0) 0x7fcdb4003620 con 0x7fcde4181e40 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcde40865b0 con 0x7fcde4181e40 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fcdd8002fa0 con 0x7fcde4181e40 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.878 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): dump: 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:05.879 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2492728539 0 0) 0x7fcde41681c0 con 0x7fcde4160340 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcdb4003620 con 0x7fcde4160340 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fcdd4003010 con 0x7fcde4160340 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient(hunting): dump: 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.880 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2682068925 0 0) 0x7fcde40865b0 con 0x7fcde4181e40 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 >> v1:10.20.193.104:6790/0 conn(0x7fcde4160340 legacy=0x7fcde4164ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 >> v1:10.20.193.119:6789/0 conn(0x7fcde405d1d0 legacy=0x7fcde4164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 monclient: found mon.a 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde4167350 con 0x7fcde4181e40 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.881 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 5 monclient: authenticate success, global_id 94317 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: _renew_subs 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1437658295 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcde4165e60 con 0x7fcde4181e40 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcdd8003230 con 0x7fcde4181e40 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 client.94317.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: _renew_subs 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fcdd8005300 con 0x7fcde4181e40 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1437658295 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcde4181ba0 con 0x7fcde4181e40 2026-02-13T08:14:05.882 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde1ffb640 4 set_mon_vals no callback set 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 librados: init done 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient: dump: 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.883 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 client.94317.objecter _submit_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 15 client.94317.objecter _session_command_op_assign -1 1 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 20 client.94317.objecter _get_session osd=-1 returning homeless 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 client.94317.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1437658295 --> v1:10.20.193.104:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fcde408a460 con 0x7fcde4181e40 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fcdd8011310 con 0x7fcde4181e40 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7fcdd804a7f0 con 0x7fcde4181e40 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 client.94317.objecter ms_dispatch2 0x7fcde4000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 3 client.94317.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 3 client.94317.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:05.884 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 client.94317.objecter checking command 1 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 20 client.94317.objecter _get_session s=0x7fcdb40610b0 osd=5 3 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 20 client.94317.objecter put_session s=0x7fcdb40610b0 osd=5 3 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 15 client.94317.objecter _session_command_op_remove -1 1 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 20 client.94317.objecter _get_session s=0x7fcdb40610b0 osd=5 3 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 20 client.94317.objecter get_session s=0x7fcdb40610b0 osd=5 3 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 15 client.94317.objecter _session_command_op_assign 5 1 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 20 client.94317.objecter put_session s=0x7fcdb40610b0 osd=5 4 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 client.94317.objecter _send_command 1 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 --> v1:10.20.193.119:6804/527707922 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcdd8003480 con 0x7fcdb4061760 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 20 client.94317.objecter dump_active .. 0 homeless 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_get_version_reply(handle=1 version=323) ==== 24+0+0 (unknown 3751641255 0 0) 0x7fcdd804ac00 con 0x7fcde4181e40 2026-02-13T08:14:05.885 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcdbffff640 10 monclient: handle_get_version_reply finishing 1 version 323 2026-02-13T08:14:05.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde37fe640 10 monclient: get_auth_request con 0x7fcdb403b7f0 auth_method 0 2026-02-13T08:14:05.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.852+0000 7fcde2ffd640 10 monclient: get_auth_request con 0x7fcdb4061760 auth_method 0 2026-02-13T08:14:05.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.856+0000 7fcdbffff640 10 client.94317.objecter ms_handle_connect 0x7fcdb403b7f0 2026-02-13T08:14:05.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.856+0000 7fcdbffff640 10 client.94317.objecter ms_handle_connect 0x7fcdb4061760 2026-02-13T08:14:05.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.856+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== osd.5 v1:10.20.193.119:6804/527707922 1 ==== command_reply(tid 1: 0 ) ==== 8+0+32513 (unknown 0 0 875166375) 0x7fcdd8003480 con 0x7fcdb4061760 2026-02-13T08:14:05.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.856+0000 7fcdbffff640 10 client.94317.objecter ms_dispatch2 0x7fcde4000ba0 command_reply(tid 1: 0 ) 2026-02-13T08:14:05.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.856+0000 7fcdbffff640 10 client.94317.objecter _finish_command 1 = system:0 2026-02-13T08:14:05.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.856+0000 7fcdbffff640 20 client.94317.objecter put_session s=0x7fcdb40610b0 osd=5 4 2026-02-13T08:14:05.886 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.856+0000 7fcdbffff640 15 client.94317.objecter _session_command_op_remove 5 1 2026-02-13T08:14:05.887 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 10 client.94317.objecter _submit_command 2 [{"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}] 2026-02-13T08:14:05.887 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 15 client.94317.objecter _session_command_op_assign -1 2 2026-02-13T08:14:05.887 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 20 client.94317.objecter _get_session s=0x7fcdb40610b0 osd=5 3 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 20 client.94317.objecter put_session s=0x7fcdb40610b0 osd=5 3 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 20 client.94317.objecter _get_session s=0x7fcdb40610b0 osd=5 3 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 15 client.94317.objecter _session_command_op_remove -1 2 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 20 client.94317.objecter get_session s=0x7fcdb40610b0 osd=5 3 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 15 client.94317.objecter _session_command_op_assign 5 2 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 20 client.94317.objecter put_session s=0x7fcdb40610b0 osd=5 4 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 10 client.94317.objecter _send_command 2 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1437658295 --> v1:10.20.193.119:6804/527707922 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcde4087ee0 con 0x7fcdb4061760 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcdbffff640 1 -- 10.20.193.104:0/1437658295 <== osd.5 v1:10.20.193.119:6804/527707922 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fcde4087ee0 con 0x7fcdb4061760 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcdbffff640 10 client.94317.objecter ms_dispatch2 0x7fcde4000ba0 command_reply(tid 2: 0 ) 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcdbffff640 10 client.94317.objecter _finish_command 2 = system:0 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcdbffff640 20 client.94317.objecter put_session s=0x7fcdb40610b0 osd=5 4 2026-02-13T08:14:05.888 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcdbffff640 15 client.94317.objecter _session_command_op_remove 5 2 2026-02-13T08:14:05.889 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-13T08:14:05.889 INFO:teuthology.orchestra.run.trial104.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-13T08:14:05.889 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-13T08:14:05.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 10 librados: watch_flush enter 2026-02-13T08:14:05.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 10 librados: watch_flush exit 2026-02-13T08:14:05.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 10 client.94317.objecter close_session for osd.5 2026-02-13T08:14:05.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1437658295 >> v1:10.20.193.119:6804/527707922 conn(0x7fcdb4061760 legacy=0x7fcdb4081bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 20 client.94317.objecter put_session s=0x7fcdb40610b0 osd=5 1 2026-02-13T08:14:05.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 20 client.94317.objecter shutdown clearing up homeless session... 2026-02-13T08:14:05.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 10 client.94317.objecter successfully canceled tick 2026-02-13T08:14:05.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1437658295 >> v1:10.20.193.119:6812/276487904 conn(0x7fcdb403b7f0 legacy=0x7fcdb405bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 10 monclient: shutdown 2026-02-13T08:14:05.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1437658295 >> v1:10.20.193.104:6789/0 conn(0x7fcde4181e40 legacy=0x7fcde4127a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde3fff640 1 -- 10.20.193.104:0/1437658295 reap_dead start 2026-02-13T08:14:05.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1437658295 shutdown_connections 2026-02-13T08:14:05.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1437658295 >> 10.20.193.104:0/1437658295 conn(0x7fcde408d6c0 msgr2=0x7fcde40867c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1437658295 shutdown_connections 2026-02-13T08:14:05.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 1 -- 10.20.193.104:0/1437658295 wait complete. 2026-02-13T08:14:05.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.864+0000 7fcde9ee8640 1 librados: shutdown 2026-02-13T08:14:05.893 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-13T08:14:05.959 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.948+0000 7fac9f06b640 10 monclient: get_monmap_and_config 2026-02-13T08:14:05.959 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.948+0000 7fac9f06b640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.959 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.948+0000 7fac9f06b640 10 monclient: monmap: 2026-02-13T08:14:05.959 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.959 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.960 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:05.955887+0000 2026-02-13T08:14:05.960 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:05.955887+0000 2026-02-13T08:14:05.960 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.960 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.960 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.960 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:05.960 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:05.960 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.968 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 Processor -- start 2026-02-13T08:14:05.968 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- start start 2026-02-13T08:14:05.968 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: init 2026-02-13T08:14:05.968 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.968 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:14:05.969 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient(hunting): picked mon.noname-b con 0x7fac98139f20 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.969 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient(hunting): picked mon.noname-a con 0x7fac9815e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.969 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient(hunting): picked mon.noname-c con 0x7fac9817fd00 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.969 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac9813aa00 con 0x7fac9815e200 2026-02-13T08:14:05.969 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac9808ba20 con 0x7fac9817fd00 2026-02-13T08:14:05.969 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac98089e30 con 0x7fac98139f20 2026-02-13T08:14:05.969 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.969 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient(hunting): authenticate will time out at 951.544588s 2026-02-13T08:14:05.969 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8ffff640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fac9815e200 0x7fac9817e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44176/0 (socket says 10.20.193.104:44176) 2026-02-13T08:14:05.969 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8ffff640 1 -- 10.20.193.104:0/1560431631 learned_addr learned my addr 10.20.193.104:0/1560431631 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.969 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9cde0640 1 --1- 10.20.193.104:0/1560431631 >> v1:10.20.193.104:6790/0 conn(0x7fac98139f20 0x7fac9813a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47966/0 (socket says 10.20.193.104:47966) 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 -- 10.20.193.104:0/1560431631 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3903063474 0 0) 0x7fac80002850 con 0x7fac9815e200 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient(hunting): my global_id is 94320 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 -- 10.20.193.104:0/1560431631 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac84003620 con 0x7fac9815e200 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 -- 10.20.193.104:0/1560431631 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166414193 0 0) 0x7fac98089e30 con 0x7fac98139f20 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient(hunting): my global_id is 104231 2026-02-13T08:14:05.970 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 -- 10.20.193.104:0/1560431631 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac80002850 con 0x7fac98139f20 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 -- 10.20.193.104:0/1560431631 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1744079809 0 0) 0x7fac84003620 con 0x7fac9815e200 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 -- 10.20.193.104:0/1560431631 >> v1:10.20.193.104:6790/0 conn(0x7fac98139f20 legacy=0x7fac9813a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 -- 10.20.193.104:0/1560431631 >> v1:10.20.193.119:6789/0 conn(0x7fac9817fd00 legacy=0x7fac981a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 monclient: found mon.noname-a 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 -- 10.20.193.104:0/1560431631 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac9808a380 con 0x7fac9815e200 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 -- 10.20.193.104:0/1560431631 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fac80002f00 con 0x7fac9815e200 2026-02-13T08:14:05.971 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient: dump: 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.972 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 5 monclient: authenticate success, global_id 94320 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 -- 10.20.193.104:0/1560431631 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac80003190 con 0x7fac9815e200 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 1 -- 10.20.193.104:0/1560431631 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fac800049a0 con 0x7fac9815e200 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8f7fe640 10 monclient: dump: 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.973 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 4 set_mon_vals no callback set 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: shutdown 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- 10.20.193.104:0/1560431631 >> v1:10.20.193.104:6789/0 conn(0x7fac9815e200 legacy=0x7fac9817e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- 10.20.193.104:0/1560431631 shutdown_connections 2026-02-13T08:14:05.974 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- 10.20.193.104:0/1560431631 >> 10.20.193.104:0/1560431631 conn(0x7fac98051a50 msgr2=0x7fac98051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- 10.20.193.104:0/1560431631 shutdown_connections 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- 10.20.193.104:0/1560431631 wait complete. 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: build_initial_monmap 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: monmap: 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:05.975 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 librados: starting msgr at 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 librados: starting objecter 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 Processor -- start 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- start start 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 librados: setting wanted keys 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 librados: calling monclient init 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: init 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient(hunting): picked mon.noname-b con 0x7fac98139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:05.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient(hunting): picked mon.noname-c con 0x7fac9815e200 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient(hunting): picked mon.noname-a con 0x7fac9817fd00 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac98162c50 con 0x7fac9817fd00 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac9817ebf0 con 0x7fac98139f20 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac98086620 con 0x7fac9815e200 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient(hunting): authenticate will time out at 951.547015s 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8ffff640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fac9815e200 0x7fac9817e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47980/0 (socket says 10.20.193.104:47980) 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8ffff640 1 -- 10.20.193.104:0/2181497534 learned_addr learned my addr 10.20.193.104:0/2181497534 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 client.?.objecter ms_handle_connect 0x7fac9815e200 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 client.?.objecter ms_handle_connect 0x7fac9817fd00 2026-02-13T08:14:05.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3910133346 0 0) 0x7fac98162c50 con 0x7fac9817fd00 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): my global_id is 94323 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac68003620 con 0x7fac9817fd00 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045122407 0 0) 0x7fac98086620 con 0x7fac9815e200 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): my global_id is 104234 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac98162c50 con 0x7fac9815e200 2026-02-13T08:14:05.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 client.?.objecter ms_handle_connect 0x7fac98139f20 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2182863025 0 0) 0x7fac68003620 con 0x7fac9817fd00 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac98086620 con 0x7fac9817fd00 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fac940033a0 con 0x7fac9817fd00 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): dump: 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.979 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 139859295 0 0) 0x7fac98162c50 con 0x7fac9815e200 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fac68003620 con 0x7fac9815e200 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fac80002d20 con 0x7fac9815e200 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): dump: 2026-02-13T08:14:05.980 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.1 v1:10.20.193.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 158994863 0 0) 0x7fac9817ebf0 con 0x7fac98139f20 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:05.981 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient(hunting): my global_id is 74767 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 --> v1:10.20.193.119:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac98162c50 con 0x7fac98139f20 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3347170401 0 0) 0x7fac98086620 con 0x7fac9817fd00 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 >> v1:10.20.193.104:6790/0 conn(0x7fac9815e200 legacy=0x7fac9817e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 >> v1:10.20.193.119:6789/0 conn(0x7fac98139f20 legacy=0x7fac9817ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient: _finish_hunting 0 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 monclient: found mon.a 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac98161de0 con 0x7fac9817fd00 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient: _finish_auth 0 2026-02-13T08:14:05.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient: _check_auth_tickets 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 5 monclient: authenticate success, global_id 94323 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: _renew_subs 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- 10.20.193.104:0/2181497534 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fac981608f0 con 0x7fac9817fd00 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 client.94323.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: _renew_subs 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 -- 10.20.193.104:0/2181497534 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fac98162970 con 0x7fac9817fd00 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 1 librados: init done 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fac94003570 con 0x7fac9817fd00 2026-02-13T08:14:05.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fac94003c60 con 0x7fac9817fd00 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8effd640 4 set_mon_vals no callback set 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac8d7fa640 10 monclient: dump: 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:05.984 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.952+0000 7fac9f06b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.956+0000 7fac9f06b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.956+0000 7fac9f06b640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.956+0000 7fac9f06b640 1 -- 10.20.193.104:0/2181497534 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac9815efa0 con 0x7fac9817fd00 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.956+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fac94003e00 con 0x7fac9817fd00 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.956+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7fac940495e0 con 0x7fac9817fd00 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.956+0000 7fac8d7fa640 10 client.94323.objecter ms_dispatch2 0x7fac98000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.956+0000 7fac8d7fa640 3 client.94323.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.956+0000 7fac8d7fa640 3 client.94323.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.956+0000 7fac8d7fa640 20 client.94323.objecter dump_active .. 0 homeless 2026-02-13T08:14:05.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.956+0000 7fac9cde0640 10 monclient: get_auth_request con 0x7fac6803ba80 auth_method 0 2026-02-13T08:14:05.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.956+0000 7fac8d7fa640 10 client.94323.objecter ms_handle_connect 0x7fac6803ba80 2026-02-13T08:14:05.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.960+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7fac94015d60 con 0x7fac9817fd00 2026-02-13T08:14:05.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.960+0000 7fac8d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:05.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:05.960+0000 7fac8d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.040+0000 7fac9f06b640 1 -- 10.20.193.104:0/2181497534 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fac980380f0 con 0x7fac6803ba80 2026-02-13T08:14:06.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.040+0000 7fac8d7fa640 1 -- 10.20.193.104:0/2181497534 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7fac980380f0 con 0x7fac6803ba80 2026-02-13T08:14:06.051 INFO:teuthology.orchestra.run.trial104.stderr:instructed osd(s) 5 to deep-scrub 2026-02-13T08:14:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.040+0000 7fac9f06b640 10 librados: watch_flush enter 2026-02-13T08:14:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.040+0000 7fac9f06b640 10 librados: watch_flush exit 2026-02-13T08:14:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.040+0000 7fac9f06b640 20 client.94323.objecter shutdown clearing up homeless session... 2026-02-13T08:14:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.040+0000 7fac9f06b640 10 client.94323.objecter successfully canceled tick 2026-02-13T08:14:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.044+0000 7fac9f06b640 1 -- 10.20.193.104:0/2181497534 >> v1:10.20.193.119:6812/276487904 conn(0x7fac6803ba80 legacy=0x7fac6805bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.044+0000 7fac9f06b640 10 monclient: shutdown 2026-02-13T08:14:06.052 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.044+0000 7fac9f06b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.044+0000 7fac9f06b640 1 -- 10.20.193.104:0/2181497534 >> v1:10.20.193.104:6789/0 conn(0x7fac9817fd00 legacy=0x7fac98127ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.044+0000 7fac9f06b640 1 -- 10.20.193.104:0/2181497534 shutdown_connections 2026-02-13T08:14:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.044+0000 7fac9f06b640 1 -- 10.20.193.104:0/2181497534 >> 10.20.193.104:0/2181497534 conn(0x7fac98051a50 msgr2=0x7fac9813ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.044+0000 7fac9f06b640 1 -- 10.20.193.104:0/2181497534 shutdown_connections 2026-02-13T08:14:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.044+0000 7fac9f06b640 1 -- 10.20.193.104:0/2181497534 wait complete. 2026-02-13T08:14:06.053 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.044+0000 7fac9f06b640 1 librados: shutdown 2026-02-13T08:14:06.061 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T08:14:06.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 10 monclient: get_monmap_and_config 2026-02-13T08:14:06.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 10 monclient: build_initial_monmap 2026-02-13T08:14:06.130 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 10 monclient: monmap: 2026-02-13T08:14:06.130 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:06.130 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:06.131 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:06.126969+0000 2026-02-13T08:14:06.131 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:06.126969+0000 2026-02-13T08:14:06.131 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:06.131 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:06.131 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:06.131 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:06.131 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:06.131 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:06.138 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 1 Processor -- start 2026-02-13T08:14:06.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 1 -- start start 2026-02-13T08:14:06.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 10 monclient: init 2026-02-13T08:14:06.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:06.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 10 monclient: _add_conns ranks=[2,0,1] 2026-02-13T08:14:06.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 10 monclient(hunting): picked mon.noname-b con 0x7f2fdc08e4b0 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:06.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 10 monclient(hunting): picked mon.noname-a con 0x7f2fdc08ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:06.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 10 monclient(hunting): picked mon.noname-c con 0x7f2fdc17ee40 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:06.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc08b8e0 con 0x7f2fdc08ef90 2026-02-13T08:14:06.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc087de0 con 0x7f2fdc17ee40 2026-02-13T08:14:06.139 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc088be0 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.120+0000 7f2fe31d3640 10 monclient(hunting): authenticate will time out at 951.715964s 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe0f48640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7f2fdc08e4b0 0x7f2fdc08e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:47982/0 (socket says 10.20.193.104:47982) 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe0f48640 1 -- 10.20.193.104:0/2591472895 learned_addr learned my addr 10.20.193.104:0/2591472895 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd3fff640 1 --1- 10.20.193.104:0/2591472895 >> v1:10.20.193.104:6789/0 conn(0x7f2fdc08ef90 0x7f2fdc17d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44188/0 (socket says 10.20.193.104:44188) 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 -- 10.20.193.104:0/2591472895 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748669274 0 0) 0x7f2fdc088be0 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient(hunting): my global_id is 104237 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 -- 10.20.193.104:0/2591472895 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc8003620 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 -- 10.20.193.104:0/2591472895 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286858878 0 0) 0x7f2fdc08b8e0 con 0x7f2fdc08ef90 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient(hunting): _negotiate 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient(hunting): my global_id is 94326 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 -- 10.20.193.104:0/2591472895 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fdc088be0 con 0x7f2fdc08ef90 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 -- 10.20.193.104:0/2591472895 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2559508836 0 0) 0x7f2fc8003620 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 -- 10.20.193.104:0/2591472895 >> v1:10.20.193.119:6789/0 conn(0x7f2fdc17ee40 legacy=0x7f2fdc19f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 -- 10.20.193.104:0/2591472895 >> v1:10.20.193.104:6789/0 conn(0x7f2fdc08ef90 legacy=0x7f2fdc17d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient: _finish_hunting 0 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 monclient: found mon.noname-b 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:10.20.193.104:6790/0 2026-02-13T08:14:06.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 -- 10.20.193.104:0/2591472895 --> v1:10.20.193.104:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc087b00 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient: _finish_auth 0 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient: _check_auth_tickets 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 -- 10.20.193.104:0/2591472895 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2fcc002e00 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient: dump: 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:06.142 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 5 monclient: authenticate success, global_id 104237 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 -- 10.20.193.104:0/2591472895 <== mon.2 v1:10.20.193.104:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fcc003040 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 1 -- 10.20.193.104:0/2591472895 <== mon.2 v1:10.20.193.104:6790/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2fcc003480 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:06.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd37fe640 10 monclient: dump: 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 4 set_mon_vals no callback set 2026-02-13T08:14:06.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: shutdown 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- 10.20.193.104:0/2591472895 >> v1:10.20.193.104:6790/0 conn(0x7f2fdc08e4b0 legacy=0x7f2fdc08e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- 10.20.193.104:0/2591472895 shutdown_connections 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- 10.20.193.104:0/2591472895 >> 10.20.193.104:0/2591472895 conn(0x7f2fdc051e80 msgr2=0x7f2fdc08c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- 10.20.193.104:0/2591472895 shutdown_connections 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- 10.20.193.104:0/2591472895 wait complete. 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: build_initial_monmap 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: monmap: 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:06.145 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 librados: starting msgr at 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 librados: starting objecter 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 Processor -- start 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- start start 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 librados: setting wanted keys 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 librados: calling monclient init 2026-02-13T08:14:06.146 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: init 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: _add_conns ranks=[0,2,1] 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient(hunting): picked mon.noname-a con 0x7f2fdc08e4b0 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient(hunting): picked mon.noname-c con 0x7f2fdc08ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient(hunting): picked mon.noname-b con 0x7f2fdc17ee40 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc05a1e0 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc0596d0 con 0x7f2fdc17ee40 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc05af20 con 0x7f2fdc08ef90 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient(hunting): authenticate will time out at 951.717641s 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe0f48640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f2fdc08e4b0 0x7f2fdc0588b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:44190/0 (socket says 10.20.193.104:44190) 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe0f48640 1 -- 10.20.193.104:0/3166490348 learned_addr learned my addr 10.20.193.104:0/3166490348 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:06.147 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 client.?.objecter ms_handle_connect 0x7f2fdc08e4b0 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 client.?.objecter ms_handle_connect 0x7f2fdc08ef90 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115070928 0 0) 0x7f2fdc05a1e0 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): my global_id is 94329 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fac003620 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1001613650 0 0) 0x7f2fdc05af20 con 0x7f2fdc08ef90 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): _negotiate 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:06.148 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): my global_id is 104240 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fdc05a1e0 con 0x7f2fdc08ef90 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1983092109 0 0) 0x7f2fac003620 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fdc05af20 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2fcc003390 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): dump: 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:06.149 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 643317393 0 0) 0x7f2fdc05a1e0 con 0x7f2fdc08ef90 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fac003620 con 0x7f2fdc08ef90 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1293061726 0 0) 0x7f2fdc05af20 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 >> v1:10.20.193.104:6790/0 conn(0x7f2fdc08ef90 legacy=0x7f2fdc058fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 >> v1:10.20.193.119:6789/0 conn(0x7f2fdc17ee40 legacy=0x7f2fdc19cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient: _finish_hunting 0 2026-02-13T08:14:06.150 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 monclient: found mon.a 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc187240 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient: _finish_auth 0 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient: _check_auth_tickets 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 client.?.objecter ms_handle_connect 0x7f2fdc17ee40 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 5 monclient: authenticate success, global_id 94329 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: _renew_subs 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- 10.20.193.104:0/3166490348 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2fdc187520 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.151 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 client.94329.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: _renew_subs 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- 10.20.193.104:0/3166490348 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2fdc185d20 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 librados: init done 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fcc004b90 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f2fcc002fc0 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 monclient: dump: 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:06.152 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd2ffd640 4 set_mon_vals no callback set 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fe31d3640 1 -- 10.20.193.104:0/3166490348 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fdc061860 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.153 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f2fcc010bb0 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f2fcc04a420 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 client.94329.objecter ms_dispatch2 0x7f2fdc000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 3 client.94329.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 3 client.94329.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 20 client.94329.objecter dump_active .. 0 homeless 2026-02-13T08:14:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd3fff640 10 monclient: get_auth_request con 0x7f2fac03b7b0 auth_method 0 2026-02-13T08:14:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.124+0000 7f2fd17fa640 10 client.94329.objecter ms_handle_connect 0x7f2fac03b7b0 2026-02-13T08:14:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.128+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f2fcc016b40 con 0x7f2fdc08e4b0 2026-02-13T08:14:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.128+0000 7f2fd17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:06.154 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.128+0000 7f2fd17fa640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:06.215 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 1 -- 10.20.193.104:0/3166490348 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fdc088830 con 0x7f2fac03b7b0 2026-02-13T08:14:06.217 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fd17fa640 1 -- 10.20.193.104:0/3166490348 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+114241 (unknown 2965378022 0 3163621189) 0x7f2fdc088830 con 0x7f2fac03b7b0 2026-02-13T08:14:06.218 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:14:06.219 INFO:teuthology.orchestra.run.trial104.stderr:dumped all 2026-02-13T08:14:06.221 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 10 librados: watch_flush enter 2026-02-13T08:14:06.221 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 10 librados: watch_flush exit 2026-02-13T08:14:06.221 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 20 client.94329.objecter shutdown clearing up homeless session... 2026-02-13T08:14:06.221 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 10 client.94329.objecter successfully canceled tick 2026-02-13T08:14:06.221 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 1 -- 10.20.193.104:0/3166490348 >> v1:10.20.193.119:6812/276487904 conn(0x7f2fac03b7b0 legacy=0x7f2fac05bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:06.221 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 10 monclient: shutdown 2026-02-13T08:14:06.221 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:06.221 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 1 -- 10.20.193.104:0/3166490348 >> v1:10.20.193.104:6789/0 conn(0x7f2fdc08e4b0 legacy=0x7f2fdc0588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:06.221 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 1 -- 10.20.193.104:0/3166490348 shutdown_connections 2026-02-13T08:14:06.221 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 1 -- 10.20.193.104:0/3166490348 >> 10.20.193.104:0/3166490348 conn(0x7f2fdc051e80 msgr2=0x7f2fdc18d700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:06.222 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 1 -- 10.20.193.104:0/3166490348 shutdown_connections 2026-02-13T08:14:06.222 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 1 -- 10.20.193.104:0/3166490348 wait complete. 2026-02-13T08:14:06.222 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:06.208+0000 7f2fe31d3640 1 librados: shutdown 2026-02-13T08:14:06.228 INFO:teuthology.orchestra.run.trial104.stdout:{"pg_ready":true,"pg_map":{"version":570,"stamp":"2026-02-13T08:14:05.932998+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":158,"num_write_kb":2685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":400360,"kb_used_data":22024,"kb_used_omap":21102,"kb_used_meta":357137,"kb_avail":565830680,"statfs":{"total":579820584960,"available":579410616320,"internally_reserved":0,"allocated":22552576,"data_stored":15637316,"data_compressed":3933748,"data_compressed_allocated":7913472,"data_compressed_original":12727568,"omap_allocated":21609368,"internal_metadata":365708392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001208"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878544+0000","last_change":"2026-02-13T08:06:16.712986+0000","last_active":"2026-02-13T08:12:35.878544+0000","last_peered":"2026-02-13T08:12:35.878544+0000","last_clean":"2026-02-13T08:12:35.878544+0000","last_became_active":"2026-02-13T08:06:16.696600+0000","last_became_peered":"2026-02-13T08:06:16.696600+0000","last_unstale":"2026-02-13T08:12:35.878544+0000","last_undegraded":"2026-02-13T08:12:35.878544+0000","last_fullsized":"2026-02-13T08:12:35.878544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:10:46.946858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885618+0000","last_change":"2026-02-13T08:06:16.753790+0000","last_active":"2026-02-13T08:12:35.885618+0000","last_peered":"2026-02-13T08:12:35.885618+0000","last_clean":"2026-02-13T08:12:35.885618+0000","last_became_active":"2026-02-13T08:06:16.748269+0000","last_became_peered":"2026-02-13T08:06:16.748269+0000","last_unstale":"2026-02-13T08:12:35.885618+0000","last_undegraded":"2026-02-13T08:12:35.885618+0000","last_fullsized":"2026-02-13T08:12:35.885618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:39:07.517559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885651+0000","last_change":"2026-02-13T08:06:16.803804+0000","last_active":"2026-02-13T08:12:35.885651+0000","last_peered":"2026-02-13T08:12:35.885651+0000","last_clean":"2026-02-13T08:12:35.885651+0000","last_became_active":"2026-02-13T08:06:16.802337+0000","last_became_peered":"2026-02-13T08:06:16.802337+0000","last_unstale":"2026-02-13T08:12:35.885651+0000","last_undegraded":"2026-02-13T08:12:35.885651+0000","last_fullsized":"2026-02-13T08:12:35.885651+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:31:11.597242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878322+0000","last_change":"2026-02-13T08:06:16.697667+0000","last_active":"2026-02-13T08:12:35.878322+0000","last_peered":"2026-02-13T08:12:35.878322+0000","last_clean":"2026-02-13T08:12:35.878322+0000","last_became_active":"2026-02-13T08:06:16.686038+0000","last_became_peered":"2026-02-13T08:06:16.686038+0000","last_unstale":"2026-02-13T08:12:35.878322+0000","last_undegraded":"2026-02-13T08:12:35.878322+0000","last_fullsized":"2026-02-13T08:12:35.878322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:57:25.281182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885553+0000","last_change":"2026-02-13T08:06:16.751888+0000","last_active":"2026-02-13T08:12:35.885553+0000","last_peered":"2026-02-13T08:12:35.885553+0000","last_clean":"2026-02-13T08:12:35.885553+0000","last_became_active":"2026-02-13T08:06:16.751147+0000","last_became_peered":"2026-02-13T08:06:16.751147+0000","last_unstale":"2026-02-13T08:12:35.885553+0000","last_undegraded":"2026-02-13T08:12:35.885553+0000","last_fullsized":"2026-02-13T08:12:35.885553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:11:19.232010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878598+0000","last_change":"2026-02-13T08:06:16.734907+0000","last_active":"2026-02-13T08:12:35.878598+0000","last_peered":"2026-02-13T08:12:35.878598+0000","last_clean":"2026-02-13T08:12:35.878598+0000","last_became_active":"2026-02-13T08:06:16.730470+0000","last_became_peered":"2026-02-13T08:06:16.730470+0000","last_unstale":"2026-02-13T08:12:35.878598+0000","last_undegraded":"2026-02-13T08:12:35.878598+0000","last_fullsized":"2026-02-13T08:12:35.878598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:11:47.396477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878647+0000","last_change":"2026-02-13T08:06:16.731624+0000","last_active":"2026-02-13T08:12:35.878647+0000","last_peered":"2026-02-13T08:12:35.878647+0000","last_clean":"2026-02-13T08:12:35.878647+0000","last_became_active":"2026-02-13T08:06:16.712405+0000","last_became_peered":"2026-02-13T08:06:16.712405+0000","last_unstale":"2026-02-13T08:12:35.878647+0000","last_undegraded":"2026-02-13T08:12:35.878647+0000","last_fullsized":"2026-02-13T08:12:35.878647+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:50:12.211360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885718+0000","last_change":"2026-02-13T08:06:16.800945+0000","last_active":"2026-02-13T08:12:35.885718+0000","last_peered":"2026-02-13T08:12:35.885718+0000","last_clean":"2026-02-13T08:12:35.885718+0000","last_became_active":"2026-02-13T08:06:16.800468+0000","last_became_peered":"2026-02-13T08:06:16.800468+0000","last_unstale":"2026-02-13T08:12:35.885718+0000","last_undegraded":"2026-02-13T08:12:35.885718+0000","last_fullsized":"2026-02-13T08:12:35.885718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:27:10.279846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878438+0000","last_change":"2026-02-13T08:06:16.683317+0000","last_active":"2026-02-13T08:12:35.878438+0000","last_peered":"2026-02-13T08:12:35.878438+0000","last_clean":"2026-02-13T08:12:35.878438+0000","last_became_active":"2026-02-13T08:06:16.674984+0000","last_became_peered":"2026-02-13T08:06:16.674984+0000","last_unstale":"2026-02-13T08:12:35.878438+0000","last_undegraded":"2026-02-13T08:12:35.878438+0000","last_fullsized":"2026-02-13T08:12:35.878438+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:06.968430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885481+0000","last_change":"2026-02-13T08:06:16.774443+0000","last_active":"2026-02-13T08:12:35.885481+0000","last_peered":"2026-02-13T08:12:35.885481+0000","last_clean":"2026-02-13T08:12:35.885481+0000","last_became_active":"2026-02-13T08:06:16.773780+0000","last_became_peered":"2026-02-13T08:06:16.773780+0000","last_unstale":"2026-02-13T08:12:35.885481+0000","last_undegraded":"2026-02-13T08:12:35.885481+0000","last_fullsized":"2026-02-13T08:12:35.885481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:19:52.327420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885657+0000","last_change":"2026-02-13T08:06:16.771409+0000","last_active":"2026-02-13T08:12:35.885657+0000","last_peered":"2026-02-13T08:12:35.885657+0000","last_clean":"2026-02-13T08:12:35.885657+0000","last_became_active":"2026-02-13T08:06:16.764687+0000","last_became_peered":"2026-02-13T08:06:16.764687+0000","last_unstale":"2026-02-13T08:12:35.885657+0000","last_undegraded":"2026-02-13T08:12:35.885657+0000","last_fullsized":"2026-02-13T08:12:35.885657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:57:37.656222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878375+0000","last_change":"2026-02-13T08:06:16.736308+0000","last_active":"2026-02-13T08:12:35.878375+0000","last_peered":"2026-02-13T08:12:35.878375+0000","last_clean":"2026-02-13T08:12:35.878375+0000","last_became_active":"2026-02-13T08:06:16.730093+0000","last_became_peered":"2026-02-13T08:06:16.730093+0000","last_unstale":"2026-02-13T08:12:35.878375+0000","last_undegraded":"2026-02-13T08:12:35.878375+0000","last_fullsized":"2026-02-13T08:12:35.878375+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:48:15.958288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.443979+0000","last_change":"2026-02-13T08:06:16.727401+0000","last_active":"2026-02-13T08:12:35.443979+0000","last_peered":"2026-02-13T08:12:35.443979+0000","last_clean":"2026-02-13T08:12:35.443979+0000","last_became_active":"2026-02-13T08:06:16.716681+0000","last_became_peered":"2026-02-13T08:06:16.716681+0000","last_unstale":"2026-02-13T08:12:35.443979+0000","last_undegraded":"2026-02-13T08:12:35.443979+0000","last_fullsized":"2026-02-13T08:12:35.443979+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:10:02.613952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885855+0000","last_change":"2026-02-13T08:05:48.689722+0000","last_active":"2026-02-13T08:12:35.885855+0000","last_peered":"2026-02-13T08:12:35.885855+0000","last_clean":"2026-02-13T08:12:35.885855+0000","last_became_active":"2026-02-13T08:05:46.332518+0000","last_became_peered":"2026-02-13T08:05:46.332518+0000","last_unstale":"2026-02-13T08:12:35.885855+0000","last_undegraded":"2026-02-13T08:12:35.885855+0000","last_fullsized":"2026-02-13T08:12:35.885855+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:27:47.031472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027820299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878588+0000","last_change":"2026-02-13T08:06:16.713035+0000","last_active":"2026-02-13T08:12:35.878588+0000","last_peered":"2026-02-13T08:12:35.878588+0000","last_clean":"2026-02-13T08:12:35.878588+0000","last_became_active":"2026-02-13T08:06:16.697543+0000","last_became_peered":"2026-02-13T08:06:16.697543+0000","last_unstale":"2026-02-13T08:12:35.878588+0000","last_undegraded":"2026-02-13T08:12:35.878588+0000","last_fullsized":"2026-02-13T08:12:35.878588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:09:18.778241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878644+0000","last_change":"2026-02-13T08:05:48.241308+0000","last_active":"2026-02-13T08:12:35.878644+0000","last_peered":"2026-02-13T08:12:35.878644+0000","last_clean":"2026-02-13T08:12:35.878644+0000","last_became_active":"2026-02-13T08:05:46.238040+0000","last_became_peered":"2026-02-13T08:05:46.238040+0000","last_unstale":"2026-02-13T08:12:35.878644+0000","last_undegraded":"2026-02-13T08:12:35.878644+0000","last_fullsized":"2026-02-13T08:12:35.878644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:28:05.237576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040397499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885278+0000","last_change":"2026-02-13T08:06:16.788039+0000","last_active":"2026-02-13T08:12:35.885278+0000","last_peered":"2026-02-13T08:12:35.885278+0000","last_clean":"2026-02-13T08:12:35.885278+0000","last_became_active":"2026-02-13T08:06:16.787708+0000","last_became_peered":"2026-02-13T08:06:16.787708+0000","last_unstale":"2026-02-13T08:12:35.885278+0000","last_undegraded":"2026-02-13T08:12:35.885278+0000","last_fullsized":"2026-02-13T08:12:35.885278+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:31:47.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885787+0000","last_change":"2026-02-13T08:05:48.689720+0000","last_active":"2026-02-13T08:12:35.885787+0000","last_peered":"2026-02-13T08:12:35.885787+0000","last_clean":"2026-02-13T08:12:35.885787+0000","last_became_active":"2026-02-13T08:05:46.419763+0000","last_became_peered":"2026-02-13T08:05:46.419763+0000","last_unstale":"2026-02-13T08:12:35.885787+0000","last_undegraded":"2026-02-13T08:12:35.885787+0000","last_fullsized":"2026-02-13T08:12:35.885787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:39:11.120130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00031193600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"21'11","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451420+0000","last_change":"2026-02-13T08:06:16.765198+0000","last_active":"2026-02-13T08:12:35.451420+0000","last_peered":"2026-02-13T08:12:35.451420+0000","last_clean":"2026-02-13T08:12:35.451420+0000","last_became_active":"2026-02-13T08:06:16.764436+0000","last_became_peered":"2026-02-13T08:06:16.764436+0000","last_unstale":"2026-02-13T08:12:35.451420+0000","last_undegraded":"2026-02-13T08:12:35.451420+0000","last_fullsized":"2026-02-13T08:12:35.451420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:02.239330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878381+0000","last_change":"2026-02-13T08:05:48.241321+0000","last_active":"2026-02-13T08:12:35.878381+0000","last_peered":"2026-02-13T08:12:35.878381+0000","last_clean":"2026-02-13T08:12:35.878381+0000","last_became_active":"2026-02-13T08:05:46.325615+0000","last_became_peered":"2026-02-13T08:05:46.325615+0000","last_unstale":"2026-02-13T08:12:35.878381+0000","last_undegraded":"2026-02-13T08:12:35.878381+0000","last_fullsized":"2026-02-13T08:12:35.878381+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:50:27.013203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041541599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885921+0000","last_change":"2026-02-13T08:06:16.770640+0000","last_active":"2026-02-13T08:12:35.885921+0000","last_peered":"2026-02-13T08:12:35.885921+0000","last_clean":"2026-02-13T08:12:35.885921+0000","last_became_active":"2026-02-13T08:06:16.755402+0000","last_became_peered":"2026-02-13T08:06:16.755402+0000","last_unstale":"2026-02-13T08:12:35.885921+0000","last_undegraded":"2026-02-13T08:12:35.885921+0000","last_fullsized":"2026-02-13T08:12:35.885921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:28:57.063487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":623,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885388+0000","last_change":"2026-02-13T08:05:48.335785+0000","last_active":"2026-02-13T08:12:35.885388+0000","last_peered":"2026-02-13T08:12:35.885388+0000","last_clean":"2026-02-13T08:12:35.885388+0000","last_became_active":"2026-02-13T08:05:46.332174+0000","last_became_peered":"2026-02-13T08:05:46.332174+0000","last_unstale":"2026-02-13T08:12:35.885388+0000","last_undegraded":"2026-02-13T08:12:35.885388+0000","last_fullsized":"2026-02-13T08:12:35.885388+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:55:06.536002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000284605,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878462+0000","last_change":"2026-02-13T08:06:16.678986+0000","last_active":"2026-02-13T08:12:35.878462+0000","last_peered":"2026-02-13T08:12:35.878462+0000","last_clean":"2026-02-13T08:12:35.878462+0000","last_became_active":"2026-02-13T08:06:16.674970+0000","last_became_peered":"2026-02-13T08:06:16.674970+0000","last_unstale":"2026-02-13T08:12:35.878462+0000","last_undegraded":"2026-02-13T08:12:35.878462+0000","last_fullsized":"2026-02-13T08:12:35.878462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:00:29.403522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.443966+0000","last_change":"2026-02-13T08:05:48.241731+0000","last_active":"2026-02-13T08:12:35.443966+0000","last_peered":"2026-02-13T08:12:35.443966+0000","last_clean":"2026-02-13T08:12:35.443966+0000","last_became_active":"2026-02-13T08:05:46.236660+0000","last_became_peered":"2026-02-13T08:05:46.236660+0000","last_unstale":"2026-02-13T08:12:35.443966+0000","last_undegraded":"2026-02-13T08:12:35.443966+0000","last_fullsized":"2026-02-13T08:12:35.443966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:54:09.509002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024995099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451485+0000","last_change":"2026-02-13T08:06:16.777794+0000","last_active":"2026-02-13T08:12:35.451485+0000","last_peered":"2026-02-13T08:12:35.451485+0000","last_clean":"2026-02-13T08:12:35.451485+0000","last_became_active":"2026-02-13T08:06:16.775702+0000","last_became_peered":"2026-02-13T08:06:16.775702+0000","last_unstale":"2026-02-13T08:12:35.451485+0000","last_undegraded":"2026-02-13T08:12:35.451485+0000","last_fullsized":"2026-02-13T08:12:35.451485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:43:38.287112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":632,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885536+0000","last_change":"2026-02-13T08:05:48.689871+0000","last_active":"2026-02-13T08:12:35.885536+0000","last_peered":"2026-02-13T08:12:35.885536+0000","last_clean":"2026-02-13T08:12:35.885536+0000","last_became_active":"2026-02-13T08:05:46.331895+0000","last_became_peered":"2026-02-13T08:05:46.331895+0000","last_unstale":"2026-02-13T08:12:35.885536+0000","last_undegraded":"2026-02-13T08:12:35.885536+0000","last_fullsized":"2026-02-13T08:12:35.885536+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:19.373004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878646+0000","last_change":"2026-02-13T08:06:16.686960+0000","last_active":"2026-02-13T08:12:35.878646+0000","last_peered":"2026-02-13T08:12:35.878646+0000","last_clean":"2026-02-13T08:12:35.878646+0000","last_became_active":"2026-02-13T08:06:16.677657+0000","last_became_peered":"2026-02-13T08:06:16.677657+0000","last_unstale":"2026-02-13T08:12:35.878646+0000","last_undegraded":"2026-02-13T08:12:35.878646+0000","last_fullsized":"2026-02-13T08:12:35.878646+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:26:32.313932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":622,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885416+0000","last_change":"2026-02-13T08:05:48.335814+0000","last_active":"2026-02-13T08:12:35.885416+0000","last_peered":"2026-02-13T08:12:35.885416+0000","last_clean":"2026-02-13T08:12:35.885416+0000","last_became_active":"2026-02-13T08:05:46.331985+0000","last_became_peered":"2026-02-13T08:05:46.331985+0000","last_unstale":"2026-02-13T08:12:35.885416+0000","last_undegraded":"2026-02-13T08:12:35.885416+0000","last_fullsized":"2026-02-13T08:12:35.885416+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:45.229245+0000","last_clean_scrub_stamp":"2026-02-13T08:05:45.229245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:31:52.202154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030744700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":770,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885589+0000","last_change":"2026-02-13T08:05:43.034445+0000","last_active":"2026-02-13T08:12:35.885589+0000","last_peered":"2026-02-13T08:12:35.885589+0000","last_clean":"2026-02-13T08:12:35.885589+0000","last_became_active":"2026-02-13T08:05:43.032364+0000","last_became_peered":"2026-02-13T08:05:43.032364+0000","last_unstale":"2026-02-13T08:12:35.885589+0000","last_undegraded":"2026-02-13T08:12:35.885589+0000","last_fullsized":"2026-02-13T08:12:35.885589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:05:41.931597+0000","last_clean_scrub_stamp":"2026-02-13T08:05:41.931597+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:28.101837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885801+0000","last_change":"2026-02-13T08:06:16.776465+0000","last_active":"2026-02-13T08:12:35.885801+0000","last_peered":"2026-02-13T08:12:35.885801+0000","last_clean":"2026-02-13T08:12:35.885801+0000","last_became_active":"2026-02-13T08:06:16.772994+0000","last_became_peered":"2026-02-13T08:06:16.772994+0000","last_unstale":"2026-02-13T08:12:35.885801+0000","last_undegraded":"2026-02-13T08:12:35.885801+0000","last_fullsized":"2026-02-13T08:12:35.885801+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:04:01.057076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451558+0000","last_change":"2026-02-13T08:06:16.786867+0000","last_active":"2026-02-13T08:12:35.451558+0000","last_peered":"2026-02-13T08:12:35.451558+0000","last_clean":"2026-02-13T08:12:35.451558+0000","last_became_active":"2026-02-13T08:06:16.784923+0000","last_became_peered":"2026-02-13T08:06:16.784923+0000","last_unstale":"2026-02-13T08:12:35.451558+0000","last_undegraded":"2026-02-13T08:12:35.451558+0000","last_fullsized":"2026-02-13T08:12:35.451558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:50:06.043735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444144+0000","last_change":"2026-02-13T08:06:16.707306+0000","last_active":"2026-02-13T08:12:35.444144+0000","last_peered":"2026-02-13T08:12:35.444144+0000","last_clean":"2026-02-13T08:12:35.444144+0000","last_became_active":"2026-02-13T08:06:16.693128+0000","last_became_peered":"2026-02-13T08:06:16.693128+0000","last_unstale":"2026-02-13T08:12:35.444144+0000","last_undegraded":"2026-02-13T08:12:35.444144+0000","last_fullsized":"2026-02-13T08:12:35.444144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:12:54.479190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878673+0000","last_change":"2026-02-13T08:06:16.707698+0000","last_active":"2026-02-13T08:12:35.878673+0000","last_peered":"2026-02-13T08:12:35.878673+0000","last_clean":"2026-02-13T08:12:35.878673+0000","last_became_active":"2026-02-13T08:06:16.706496+0000","last_became_peered":"2026-02-13T08:06:16.706496+0000","last_unstale":"2026-02-13T08:12:35.878673+0000","last_undegraded":"2026-02-13T08:12:35.878673+0000","last_fullsized":"2026-02-13T08:12:35.878673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:51:56.806272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444046+0000","last_change":"2026-02-13T08:06:16.715614+0000","last_active":"2026-02-13T08:12:35.444046+0000","last_peered":"2026-02-13T08:12:35.444046+0000","last_clean":"2026-02-13T08:12:35.444046+0000","last_became_active":"2026-02-13T08:06:16.704582+0000","last_became_peered":"2026-02-13T08:06:16.704582+0000","last_unstale":"2026-02-13T08:12:35.444046+0000","last_undegraded":"2026-02-13T08:12:35.444046+0000","last_fullsized":"2026-02-13T08:12:35.444046+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:44:44.321422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":604,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878343+0000","last_change":"2026-02-13T08:06:16.704281+0000","last_active":"2026-02-13T08:12:35.878343+0000","last_peered":"2026-02-13T08:12:35.878343+0000","last_clean":"2026-02-13T08:12:35.878343+0000","last_became_active":"2026-02-13T08:06:16.703565+0000","last_became_peered":"2026-02-13T08:06:16.703565+0000","last_unstale":"2026-02-13T08:12:35.878343+0000","last_undegraded":"2026-02-13T08:12:35.878343+0000","last_fullsized":"2026-02-13T08:12:35.878343+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:23:50.778453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.444069+0000","last_change":"2026-02-13T08:06:16.723599+0000","last_active":"2026-02-13T08:12:35.444069+0000","last_peered":"2026-02-13T08:12:35.444069+0000","last_clean":"2026-02-13T08:12:35.444069+0000","last_became_active":"2026-02-13T08:06:16.714959+0000","last_became_peered":"2026-02-13T08:06:16.714959+0000","last_unstale":"2026-02-13T08:12:35.444069+0000","last_undegraded":"2026-02-13T08:12:35.444069+0000","last_fullsized":"2026-02-13T08:12:35.444069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:40:57.442734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878397+0000","last_change":"2026-02-13T08:06:16.712337+0000","last_active":"2026-02-13T08:12:35.878397+0000","last_peered":"2026-02-13T08:12:35.878397+0000","last_clean":"2026-02-13T08:12:35.878397+0000","last_became_active":"2026-02-13T08:06:16.706451+0000","last_became_peered":"2026-02-13T08:06:16.706451+0000","last_unstale":"2026-02-13T08:12:35.878397+0000","last_undegraded":"2026-02-13T08:12:35.878397+0000","last_fullsized":"2026-02-13T08:12:35.878397+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:52:30.382122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":608,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.878472+0000","last_change":"2026-02-13T08:06:16.741236+0000","last_active":"2026-02-13T08:12:35.878472+0000","last_peered":"2026-02-13T08:12:35.878472+0000","last_clean":"2026-02-13T08:12:35.878472+0000","last_became_active":"2026-02-13T08:06:16.737141+0000","last_became_peered":"2026-02-13T08:06:16.737141+0000","last_unstale":"2026-02-13T08:12:35.878472+0000","last_undegraded":"2026-02-13T08:12:35.878472+0000","last_fullsized":"2026-02-13T08:12:35.878472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:44:46.098224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":618,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885849+0000","last_change":"2026-02-13T08:06:16.794002+0000","last_active":"2026-02-13T08:12:35.885849+0000","last_peered":"2026-02-13T08:12:35.885849+0000","last_clean":"2026-02-13T08:12:35.885849+0000","last_became_active":"2026-02-13T08:06:16.791964+0000","last_became_peered":"2026-02-13T08:06:16.791964+0000","last_unstale":"2026-02-13T08:12:35.885849+0000","last_undegraded":"2026-02-13T08:12:35.885849+0000","last_fullsized":"2026-02-13T08:12:35.885849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:37.844323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":605,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.451518+0000","last_change":"2026-02-13T08:06:16.765157+0000","last_active":"2026-02-13T08:12:35.451518+0000","last_peered":"2026-02-13T08:12:35.451518+0000","last_clean":"2026-02-13T08:12:35.451518+0000","last_became_active":"2026-02-13T08:06:16.764042+0000","last_became_peered":"2026-02-13T08:06:16.764042+0000","last_unstale":"2026-02-13T08:12:35.451518+0000","last_undegraded":"2026-02-13T08:12:35.451518+0000","last_fullsized":"2026-02-13T08:12:35.451518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:28:31.364151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":606,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:12:35.885649+0000","last_change":"2026-02-13T08:06:16.799617+0000","last_active":"2026-02-13T08:12:35.885649+0000","last_peered":"2026-02-13T08:12:35.885649+0000","last_clean":"2026-02-13T08:12:35.885649+0000","last_became_active":"2026-02-13T08:06:16.799194+0000","last_became_peered":"2026-02-13T08:06:16.799194+0000","last_unstale":"2026-02-13T08:12:35.885649+0000","last_undegraded":"2026-02-13T08:12:35.885649+0000","last_fullsized":"2026-02-13T08:12:35.885649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:06:15.590832+0000","last_clean_scrub_stamp":"2026-02-13T08:06:15.590832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:43:24.016414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":1180736,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640358,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":4613,"kb_used_meta":58426,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409441,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":4724473,"internal_metadata":59828487},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640358,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":3011,"kb_used_meta":60028,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409427,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":3083702,"internal_metadata":61469258},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640358,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66756,"kb_used_data":3700,"kb_used_omap":3015,"kb_used_meta":60024,"kb_avail":94305084,"statfs":{"total":96636764160,"available":96568406016,"internally_reserved":0,"allocated":3788800,"data_stored":2999790,"data_compressed":663918,"data_compressed_allocated":1351680,"data_compressed_original":2514840,"omap_allocated":3088323,"internal_metadata":61464637},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640358,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66708,"kb_used_data":3652,"kb_used_omap":2924,"kb_used_meta":60115,"kb_avail":94305132,"statfs":{"total":96636764160,"available":96568455168,"internally_reserved":0,"allocated":3739648,"data_stored":2409422,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":2994630,"internal_metadata":61558330},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640359,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":5013,"kb_used_meta":58026,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409441,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":5134330,"internal_metadata":59418630},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640358,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66760,"kb_used_data":3704,"kb_used_omap":2523,"kb_used_meta":60516,"kb_avail":94305080,"statfs":{"total":96636764160,"available":96568401920,"internally_reserved":0,"allocated":3792896,"data_stored":2999795,"data_compressed":663918,"data_compressed_allocated":1351680,"data_compressed_original":2514840,"omap_allocated":2583910,"internal_metadata":61969050},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T08:14:06.235 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.235 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.235 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.235 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.236 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.236 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.236 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.236 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.236 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.236 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.237 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.237 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.237 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.237 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-13T08:05:45.229245+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=5, tm_sec=45, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.237 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.237 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-13T08:05:45.229245+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=5, tm_sec=45, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.237 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.238 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-13T08:05:45.229245+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=5, tm_sec=45, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.238 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.238 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-13T08:05:45.229245+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=5, tm_sec=45, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.238 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.238 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-13T08:05:45.229245+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=5, tm_sec=45, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.238 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.238 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-13T08:05:45.229245+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=5, tm_sec=45, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.238 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.239 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-13T08:05:45.229245+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=5, tm_sec=45, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.239 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.239 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-13T08:05:45.229245+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=5, tm_sec=45, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.239 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-13T08:05:41.931597+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=5, tm_sec=41, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.239 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.239 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.239 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.240 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.240 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.240 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.240 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.240 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.240 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.240 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.241 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.241 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2026-02-13T08:06:15.590832+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=6, tm_sec=15, tm_wday=4, tm_yday=44, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=13, tm_hour=8, tm_min=14, tm_sec=3, tm_wday=4, tm_yday=44, tm_isdst=0) 2026-02-13T08:14:06.241 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-13T08:14:26.242 DEBUG:teuthology.orchestra.run.trial104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-13T08:14:26.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.303+0000 7fc0d4ce9640 10 monclient: get_monmap_and_config 2026-02-13T08:14:26.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.303+0000 7fc0d4ce9640 10 monclient: build_initial_monmap 2026-02-13T08:14:26.311 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.303+0000 7fc0d4ce9640 10 monclient: monmap: 2026-02-13T08:14:26.311 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:26.311 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.311 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:26.307514+0000 2026-02-13T08:14:26.311 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:26.307514+0000 2026-02-13T08:14:26.311 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:26.312 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.312 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:26.312 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:26.312 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:26.312 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.320 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.303+0000 7fc0d4ce9640 1 Processor -- start 2026-02-13T08:14:26.320 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.303+0000 7fc0d4ce9640 1 -- start start 2026-02-13T08:14:26.320 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.303+0000 7fc0d4ce9640 10 monclient: init 2026-02-13T08:14:26.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:26.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: _add_conns ranks=[1,2,0] 2026-02-13T08:14:26.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient(hunting): picked mon.noname-c con 0x7fc0d008e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:26.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient(hunting): picked mon.noname-b con 0x7fc0d008ef90 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:26.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient(hunting): picked mon.noname-a con 0x7fc0d017fe50 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:26.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d0089fa0 con 0x7fc0d017fe50 2026-02-13T08:14:26.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d0089760 con 0x7fc0d008e4b0 2026-02-13T08:14:26.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d008af90 con 0x7fc0d008ef90 2026-02-13T08:14:26.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:26.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient(hunting): authenticate will time out at 971.896249s 2026-02-13T08:14:26.321 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cdd74640 1 --1- >> v1:10.20.193.104:6790/0 conn(0x7fc0d008ef90 0x7fc0d017e730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6790/0 says I am v1:10.20.193.104:56850/0 (socket says 10.20.193.104:56850) 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0ced76640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fc0d017fe50 0x7fc0d01a0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:46608/0 (socket says 10.20.193.104:46608) 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cdd74640 1 -- 10.20.193.104:0/454827623 learned_addr learned my addr 10.20.193.104:0/454827623 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 -- 10.20.193.104:0/454827623 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3662772869 0 0) 0x7fc0d008af90 con 0x7fc0d008ef90 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient(hunting): _negotiate 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient(hunting): my global_id is 104243 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 -- 10.20.193.104:0/454827623 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0bc003620 con 0x7fc0d008ef90 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 -- 10.20.193.104:0/454827623 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1106061715 0 0) 0x7fc0d0089fa0 con 0x7fc0d017fe50 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient(hunting): _negotiate 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:26.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient(hunting): my global_id is 94332 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 -- 10.20.193.104:0/454827623 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0d008af90 con 0x7fc0d017fe50 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 -- 10.20.193.104:0/454827623 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3175324100 0 0) 0x7fc0d008af90 con 0x7fc0d017fe50 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 -- 10.20.193.104:0/454827623 >> v1:10.20.193.104:6790/0 conn(0x7fc0d008ef90 legacy=0x7fc0d017e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 -- 10.20.193.104:0/454827623 >> v1:10.20.193.119:6789/0 conn(0x7fc0d008e4b0 legacy=0x7fc0d008e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient: _finish_hunting 0 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 monclient: found mon.noname-a 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 -- 10.20.193.104:0/454827623 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d008b270 con 0x7fc0d017fe50 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient: _finish_auth 0 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient: _check_auth_tickets 2026-02-13T08:14:26.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 -- 10.20.193.104:0/454827623 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc0c0003180 con 0x7fc0d017fe50 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient: dump: 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:26.324 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 5 monclient: authenticate success, global_id 94332 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 -- 10.20.193.104:0/454827623 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc0c0003480 con 0x7fc0d017fe50 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 1 -- 10.20.193.104:0/454827623 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc0c00038c0 con 0x7fc0d017fe50 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cd573640 10 monclient: dump: 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:26.325 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 4 set_mon_vals no callback set 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: shutdown 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:26.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/454827623 >> v1:10.20.193.104:6789/0 conn(0x7fc0d017fe50 legacy=0x7fc0d01a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/454827623 shutdown_connections 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/454827623 >> 10.20.193.104:0/454827623 conn(0x7fc0d0051e80 msgr2=0x7fc0d008c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/454827623 shutdown_connections 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/454827623 wait complete. 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: build_initial_monmap 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: monmap: 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:26.327 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 librados: starting msgr at 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 librados: starting objecter 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 Processor -- start 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- start start 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 librados: setting wanted keys 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 librados: calling monclient init 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: init 2026-02-13T08:14:26.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient(hunting): picked mon.noname-b con 0x7fc0d008e4b0 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient(hunting): picked mon.noname-a con 0x7fc0d008ef90 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient(hunting): picked mon.noname-c con 0x7fc0d017fe50 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d0086790 con 0x7fc0d008ef90 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d007ea60 con 0x7fc0d008e4b0 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0d007ed40 con 0x7fc0d017fe50 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient(hunting): authenticate will time out at 971.898113s 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cdd74640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7fc0d008ef90 0x7fc0d007b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:46614/0 (socket says 10.20.193.104:46614) 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0cdd74640 1 -- 10.20.193.104:0/2809891217 learned_addr learned my addr 10.20.193.104:0/2809891217 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 client.?.objecter ms_handle_connect 0x7fc0d008ef90 2026-02-13T08:14:26.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 client.?.objecter ms_handle_connect 0x7fc0d017fe50 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808394973 0 0) 0x7fc0bc003620 con 0x7fc0d008ef90 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): my global_id is 94335 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc09c003620 con 0x7fc0d008ef90 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 71764374 0 0) 0x7fc0d007ed40 con 0x7fc0d017fe50 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): _negotiate 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:26.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): my global_id is 104246 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0bc003620 con 0x7fc0d017fe50 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3675221620 0 0) 0x7fc09c003620 con 0x7fc0d008ef90 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0d007ed40 con 0x7fc0d008ef90 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc0b80030c0 con 0x7fc0d008ef90 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): dump: 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.331 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 client.?.objecter ms_handle_connect 0x7fc0d008e4b0 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 50081284 0 0) 0x7fc0bc003620 con 0x7fc0d017fe50 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc09c003620 con 0x7fc0d017fe50 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc0c0002fa0 con 0x7fc0d017fe50 2026-02-13T08:14:26.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient(hunting): dump: 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3983120416 0 0) 0x7fc0d007ed40 con 0x7fc0d008ef90 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 >> v1:10.20.193.104:6790/0 conn(0x7fc0d017fe50 legacy=0x7fc0d0170840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 >> v1:10.20.193.119:6789/0 conn(0x7fc0d008e4b0 legacy=0x7fc0d007af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient: _finish_hunting 0 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 monclient: found mon.a 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d007ded0 con 0x7fc0d008ef90 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient: _finish_auth 0 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient: _check_auth_tickets 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 5 monclient: authenticate success, global_id 94335 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: _renew_subs 2026-02-13T08:14:26.334 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/2809891217 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d007c9e0 con 0x7fc0d008ef90 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 client.94335.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: _renew_subs 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/2809891217 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc0d007d710 con 0x7fc0d008ef90 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 librados: init done 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc0b80048e0 con 0x7fc0d008ef90 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7fc0b8004c30 con 0x7fc0d008ef90 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 monclient: dump: 2026-02-13T08:14:26.335 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0ccd72640 4 set_mon_vals no callback set 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:26.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/2809891217 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d0061860 con 0x7fc0d008ef90 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7fc0b8010c40 con 0x7fc0d008ef90 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7fc0b804a560 con 0x7fc0d008ef90 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 client.94335.objecter ms_dispatch2 0x7fc0d0000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 3 client.94335.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 3 client.94335.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 20 client.94335.objecter dump_active .. 0 homeless 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0ce575640 10 monclient: get_auth_request con 0x7fc09c03b7c0 auth_method 0 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.307+0000 7fc0b6ffd640 10 client.94335.objecter ms_handle_connect 0x7fc09c03b7c0 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.311+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7fc0d0086790 con 0x7fc0d008ef90 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.311+0000 7fc0b6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:26.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.311+0000 7fc0b6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:26.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/2809891217 --> v1:10.20.193.119:6812/276487904 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0d008cc70 con 0x7fc09c03b7c0 2026-02-13T08:14:26.397 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0b6ffd640 1 -- 10.20.193.104:0/2809891217 <== mgr.4105 v1:10.20.193.119:6812/276487904 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+114267 (unknown 2965378022 0 668331817) 0x7fc0d008cc70 con 0x7fc09c03b7c0 2026-02-13T08:14:26.399 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-13T08:14:26.399 INFO:teuthology.orchestra.run.trial104.stderr:dumped all 2026-02-13T08:14:26.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 10 librados: watch_flush enter 2026-02-13T08:14:26.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 10 librados: watch_flush exit 2026-02-13T08:14:26.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 20 client.94335.objecter shutdown clearing up homeless session... 2026-02-13T08:14:26.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 10 client.94335.objecter successfully canceled tick 2026-02-13T08:14:26.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/2809891217 >> v1:10.20.193.119:6812/276487904 conn(0x7fc09c03b7c0 legacy=0x7fc09c05bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 10 monclient: shutdown 2026-02-13T08:14:26.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:26.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/2809891217 >> v1:10.20.193.104:6789/0 conn(0x7fc0d008ef90 legacy=0x7fc0d007b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/2809891217 shutdown_connections 2026-02-13T08:14:26.401 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/2809891217 >> 10.20.193.104:0/2809891217 conn(0x7fc0d0051e80 msgr2=0x7fc0d00869a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:26.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/2809891217 shutdown_connections 2026-02-13T08:14:26.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 1 -- 10.20.193.104:0/2809891217 wait complete. 2026-02-13T08:14:26.402 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.391+0000 7fc0d4ce9640 1 librados: shutdown 2026-02-13T08:14:26.408 INFO:teuthology.orchestra.run.trial104.stdout:{"pg_ready":true,"pg_map":{"version":580,"stamp":"2026-02-13T08:14:25.935037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590392,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":158,"num_write_kb":2685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":400360,"kb_used_data":22024,"kb_used_omap":21102,"kb_used_meta":357137,"kb_avail":565830680,"statfs":{"total":579820584960,"available":579410616320,"internally_reserved":0,"allocated":22552576,"data_stored":15637316,"data_compressed":3933748,"data_compressed_allocated":7913472,"data_compressed_original":12727568,"omap_allocated":21609368,"internal_metadata":365708392},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001245"},"pg_stats":[{"pgid":"7.1b","version":"0'0","reported_seq":612,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:08.844319+0000","last_change":"2026-02-13T08:14:08.844319+0000","last_active":"2026-02-13T08:14:08.844319+0000","last_peered":"2026-02-13T08:14:08.844319+0000","last_clean":"2026-02-13T08:14:08.844319+0000","last_became_active":"2026-02-13T08:06:16.696600+0000","last_became_peered":"2026-02-13T08:06:16.696600+0000","last_unstale":"2026-02-13T08:14:08.844319+0000","last_undegraded":"2026-02-13T08:14:08.844319+0000","last_fullsized":"2026-02-13T08:14:08.844319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:08.844245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:08.844245+0000","last_clean_scrub_stamp":"2026-02-13T08:14:08.844245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:03:44.939134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":626,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:14.710775+0000","last_change":"2026-02-13T08:14:14.710775+0000","last_active":"2026-02-13T08:14:14.710775+0000","last_peered":"2026-02-13T08:14:14.710775+0000","last_clean":"2026-02-13T08:14:14.710775+0000","last_became_active":"2026-02-13T08:06:16.748269+0000","last_became_peered":"2026-02-13T08:06:16.748269+0000","last_unstale":"2026-02-13T08:14:14.710775+0000","last_undegraded":"2026-02-13T08:14:14.710775+0000","last_fullsized":"2026-02-13T08:14:14.710775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:14.710693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:14.710693+0000","last_clean_scrub_stamp":"2026-02-13T08:14:14.710693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:11:46.802372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":626,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:12.679494+0000","last_change":"2026-02-13T08:14:12.679494+0000","last_active":"2026-02-13T08:14:12.679494+0000","last_peered":"2026-02-13T08:14:12.679494+0000","last_clean":"2026-02-13T08:14:12.679494+0000","last_became_active":"2026-02-13T08:06:16.802337+0000","last_became_peered":"2026-02-13T08:06:16.802337+0000","last_unstale":"2026-02-13T08:14:12.679494+0000","last_undegraded":"2026-02-13T08:14:12.679494+0000","last_fullsized":"2026-02-13T08:14:12.679494+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:12.679432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:12.679432+0000","last_clean_scrub_stamp":"2026-02-13T08:14:12.679432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:23:44.589661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":612,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:10.782740+0000","last_change":"2026-02-13T08:14:10.782740+0000","last_active":"2026-02-13T08:14:10.782740+0000","last_peered":"2026-02-13T08:14:10.782740+0000","last_clean":"2026-02-13T08:14:10.782740+0000","last_became_active":"2026-02-13T08:06:16.686038+0000","last_became_peered":"2026-02-13T08:06:16.686038+0000","last_unstale":"2026-02-13T08:14:10.782740+0000","last_undegraded":"2026-02-13T08:14:10.782740+0000","last_fullsized":"2026-02-13T08:14:10.782740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:10.782665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:10.782665+0000","last_clean_scrub_stamp":"2026-02-13T08:14:10.782665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:07:43.043053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":614,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:12.014163+0000","last_change":"2026-02-13T08:14:12.014163+0000","last_active":"2026-02-13T08:14:12.014163+0000","last_peered":"2026-02-13T08:14:12.014163+0000","last_clean":"2026-02-13T08:14:12.014163+0000","last_became_active":"2026-02-13T08:06:16.751147+0000","last_became_peered":"2026-02-13T08:06:16.751147+0000","last_unstale":"2026-02-13T08:14:12.014163+0000","last_undegraded":"2026-02-13T08:14:12.014163+0000","last_fullsized":"2026-02-13T08:14:12.014163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:12.014092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:12.014092+0000","last_clean_scrub_stamp":"2026-02-13T08:14:12.014092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:42:36.631069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":617,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:11.616686+0000","last_change":"2026-02-13T08:14:11.616628+0000","last_active":"2026-02-13T08:14:11.616686+0000","last_peered":"2026-02-13T08:14:11.616686+0000","last_clean":"2026-02-13T08:14:11.616686+0000","last_became_active":"2026-02-13T08:06:16.730470+0000","last_became_peered":"2026-02-13T08:06:16.730470+0000","last_unstale":"2026-02-13T08:14:11.616686+0000","last_undegraded":"2026-02-13T08:14:11.616686+0000","last_fullsized":"2026-02-13T08:14:11.616686+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:11.616574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:11.616574+0000","last_clean_scrub_stamp":"2026-02-13T08:14:11.616574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:25:47.413818+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":616,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:09.574521+0000","last_change":"2026-02-13T08:14:09.574521+0000","last_active":"2026-02-13T08:14:09.574521+0000","last_peered":"2026-02-13T08:14:09.574521+0000","last_clean":"2026-02-13T08:14:09.574521+0000","last_became_active":"2026-02-13T08:06:16.712405+0000","last_became_peered":"2026-02-13T08:06:16.712405+0000","last_unstale":"2026-02-13T08:14:09.574521+0000","last_undegraded":"2026-02-13T08:14:09.574521+0000","last_fullsized":"2026-02-13T08:14:09.574521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:09.574471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:09.574471+0000","last_clean_scrub_stamp":"2026-02-13T08:14:09.574471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:25:10.927739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":626,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:15.699526+0000","last_change":"2026-02-13T08:14:15.699526+0000","last_active":"2026-02-13T08:14:15.699526+0000","last_peered":"2026-02-13T08:14:15.699526+0000","last_clean":"2026-02-13T08:14:15.699526+0000","last_became_active":"2026-02-13T08:06:16.800468+0000","last_became_peered":"2026-02-13T08:06:16.800468+0000","last_unstale":"2026-02-13T08:14:15.699526+0000","last_undegraded":"2026-02-13T08:14:15.699526+0000","last_fullsized":"2026-02-13T08:14:15.699526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:15.699449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:15.699449+0000","last_clean_scrub_stamp":"2026-02-13T08:14:15.699449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:25:39.338157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":612,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:09.799490+0000","last_change":"2026-02-13T08:14:09.799490+0000","last_active":"2026-02-13T08:14:09.799490+0000","last_peered":"2026-02-13T08:14:09.799490+0000","last_clean":"2026-02-13T08:14:09.799490+0000","last_became_active":"2026-02-13T08:06:16.674984+0000","last_became_peered":"2026-02-13T08:06:16.674984+0000","last_unstale":"2026-02-13T08:14:09.799490+0000","last_undegraded":"2026-02-13T08:14:09.799490+0000","last_fullsized":"2026-02-13T08:14:09.799490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:09.799415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:09.799415+0000","last_clean_scrub_stamp":"2026-02-13T08:14:09.799415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:34:35.672842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":614,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:10.004174+0000","last_change":"2026-02-13T08:14:10.004174+0000","last_active":"2026-02-13T08:14:10.004174+0000","last_peered":"2026-02-13T08:14:10.004174+0000","last_clean":"2026-02-13T08:14:10.004174+0000","last_became_active":"2026-02-13T08:06:16.773780+0000","last_became_peered":"2026-02-13T08:06:16.773780+0000","last_unstale":"2026-02-13T08:14:10.004174+0000","last_undegraded":"2026-02-13T08:14:10.004174+0000","last_fullsized":"2026-02-13T08:14:10.004174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:10.004099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:10.004099+0000","last_clean_scrub_stamp":"2026-02-13T08:14:10.004099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:50:13.551255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":626,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:10.681785+0000","last_change":"2026-02-13T08:14:10.681785+0000","last_active":"2026-02-13T08:14:10.681785+0000","last_peered":"2026-02-13T08:14:10.681785+0000","last_clean":"2026-02-13T08:14:10.681785+0000","last_became_active":"2026-02-13T08:06:16.764687+0000","last_became_peered":"2026-02-13T08:06:16.764687+0000","last_unstale":"2026-02-13T08:14:10.681785+0000","last_undegraded":"2026-02-13T08:14:10.681785+0000","last_fullsized":"2026-02-13T08:14:10.681785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:10.681724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:10.681724+0000","last_clean_scrub_stamp":"2026-02-13T08:14:10.681724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:13:52.052766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":616,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:10.610810+0000","last_change":"2026-02-13T08:14:10.610810+0000","last_active":"2026-02-13T08:14:10.610810+0000","last_peered":"2026-02-13T08:14:10.610810+0000","last_clean":"2026-02-13T08:14:10.610810+0000","last_became_active":"2026-02-13T08:06:16.730093+0000","last_became_peered":"2026-02-13T08:06:16.730093+0000","last_unstale":"2026-02-13T08:14:10.610810+0000","last_undegraded":"2026-02-13T08:14:10.610810+0000","last_fullsized":"2026-02-13T08:14:10.610810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:10.610727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:10.610727+0000","last_clean_scrub_stamp":"2026-02-13T08:14:10.610727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:18:52.885249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":613,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:06.661967+0000","last_change":"2026-02-13T08:14:06.661967+0000","last_active":"2026-02-13T08:14:06.661967+0000","last_peered":"2026-02-13T08:14:06.661967+0000","last_clean":"2026-02-13T08:14:06.661967+0000","last_became_active":"2026-02-13T08:06:16.716681+0000","last_became_peered":"2026-02-13T08:06:16.716681+0000","last_unstale":"2026-02-13T08:14:06.661967+0000","last_undegraded":"2026-02-13T08:14:06.661967+0000","last_fullsized":"2026-02-13T08:14:06.661967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:06.661886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:06.661886+0000","last_clean_scrub_stamp":"2026-02-13T08:14:06.661886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:04:46.142595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":639,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:07.676957+0000","last_change":"2026-02-13T08:14:07.676957+0000","last_active":"2026-02-13T08:14:07.676957+0000","last_peered":"2026-02-13T08:14:07.676957+0000","last_clean":"2026-02-13T08:14:07.676957+0000","last_became_active":"2026-02-13T08:05:46.332518+0000","last_became_peered":"2026-02-13T08:05:46.332518+0000","last_unstale":"2026-02-13T08:14:07.676957+0000","last_undegraded":"2026-02-13T08:14:07.676957+0000","last_fullsized":"2026-02-13T08:14:07.676957+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:07.676902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:07.676902+0000","last_clean_scrub_stamp":"2026-02-13T08:14:07.676902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:09:15.020184+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00027820299999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":612,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:04.858174+0000","last_change":"2026-02-13T08:14:04.858174+0000","last_active":"2026-02-13T08:14:04.858174+0000","last_peered":"2026-02-13T08:14:04.858174+0000","last_clean":"2026-02-13T08:14:04.858174+0000","last_became_active":"2026-02-13T08:06:16.697543+0000","last_became_peered":"2026-02-13T08:06:16.697543+0000","last_unstale":"2026-02-13T08:14:04.858174+0000","last_undegraded":"2026-02-13T08:14:04.858174+0000","last_fullsized":"2026-02-13T08:14:04.858174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:04.858126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:04.858126+0000","last_clean_scrub_stamp":"2026-02-13T08:14:04.858126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:55:30.036688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":631,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:06.590135+0000","last_change":"2026-02-13T08:14:06.590135+0000","last_active":"2026-02-13T08:14:06.590135+0000","last_peered":"2026-02-13T08:14:06.590135+0000","last_clean":"2026-02-13T08:14:06.590135+0000","last_became_active":"2026-02-13T08:05:46.238040+0000","last_became_peered":"2026-02-13T08:05:46.238040+0000","last_unstale":"2026-02-13T08:14:06.590135+0000","last_undegraded":"2026-02-13T08:14:06.590135+0000","last_fullsized":"2026-02-13T08:14:06.590135+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:06.590065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:06.590065+0000","last_clean_scrub_stamp":"2026-02-13T08:14:06.590065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:48:30.302519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040397499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":615,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:08.977235+0000","last_change":"2026-02-13T08:14:08.977199+0000","last_active":"2026-02-13T08:14:08.977235+0000","last_peered":"2026-02-13T08:14:08.977235+0000","last_clean":"2026-02-13T08:14:08.977235+0000","last_became_active":"2026-02-13T08:06:16.787708+0000","last_became_peered":"2026-02-13T08:06:16.787708+0000","last_unstale":"2026-02-13T08:14:08.977235+0000","last_undegraded":"2026-02-13T08:14:08.977235+0000","last_fullsized":"2026-02-13T08:14:08.977235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:08.977149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:08.977149+0000","last_clean_scrub_stamp":"2026-02-13T08:14:08.977149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:20:08.386668+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":640,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:05.649363+0000","last_change":"2026-02-13T08:14:05.649295+0000","last_active":"2026-02-13T08:14:05.649363+0000","last_peered":"2026-02-13T08:14:05.649363+0000","last_clean":"2026-02-13T08:14:05.649363+0000","last_became_active":"2026-02-13T08:05:46.419763+0000","last_became_peered":"2026-02-13T08:05:46.419763+0000","last_unstale":"2026-02-13T08:14:05.649363+0000","last_undegraded":"2026-02-13T08:14:05.649363+0000","last_fullsized":"2026-02-13T08:14:05.649363+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:05.649229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:05.649229+0000","last_clean_scrub_stamp":"2026-02-13T08:14:05.649229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:58:16.157178+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0.00031193600000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"323'12","reported_seq":640,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:06.778624+0000","last_change":"2026-02-13T08:14:06.778624+0000","last_active":"2026-02-13T08:14:06.778624+0000","last_peered":"2026-02-13T08:14:06.778624+0000","last_clean":"2026-02-13T08:14:06.778624+0000","last_became_active":"2026-02-13T08:06:16.764436+0000","last_became_peered":"2026-02-13T08:06:16.764436+0000","last_unstale":"2026-02-13T08:14:06.778624+0000","last_undegraded":"2026-02-13T08:14:06.778624+0000","last_fullsized":"2026-02-13T08:14:06.778624+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"323'12","last_scrub_stamp":"2026-02-13T08:14:06.778565+0000","last_deep_scrub":"323'12","last_deep_scrub_stamp":"2026-02-13T08:14:06.778565+0000","last_clean_scrub_stamp":"2026-02-13T08:14:06.778565+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:28:31.805056+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":632,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:05.554167+0000","last_change":"2026-02-13T08:14:05.554103+0000","last_active":"2026-02-13T08:14:05.554167+0000","last_peered":"2026-02-13T08:14:05.554167+0000","last_clean":"2026-02-13T08:14:05.554167+0000","last_became_active":"2026-02-13T08:05:46.325615+0000","last_became_peered":"2026-02-13T08:05:46.325615+0000","last_unstale":"2026-02-13T08:14:05.554167+0000","last_undegraded":"2026-02-13T08:14:05.554167+0000","last_fullsized":"2026-02-13T08:14:05.554167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:05.554041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:05.554041+0000","last_clean_scrub_stamp":"2026-02-13T08:14:05.554041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:46:45.719136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041541599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":626,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:09.683229+0000","last_change":"2026-02-13T08:14:09.683229+0000","last_active":"2026-02-13T08:14:09.683229+0000","last_peered":"2026-02-13T08:14:09.683229+0000","last_clean":"2026-02-13T08:14:09.683229+0000","last_became_active":"2026-02-13T08:06:16.755402+0000","last_became_peered":"2026-02-13T08:06:16.755402+0000","last_unstale":"2026-02-13T08:14:09.683229+0000","last_undegraded":"2026-02-13T08:14:09.683229+0000","last_fullsized":"2026-02-13T08:14:09.683229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:09.683169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:09.683169+0000","last_clean_scrub_stamp":"2026-02-13T08:14:09.683169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:28:32.165994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"323'3","reported_seq":633,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:07.007509+0000","last_change":"2026-02-13T08:14:07.007509+0000","last_active":"2026-02-13T08:14:07.007509+0000","last_peered":"2026-02-13T08:14:07.007509+0000","last_clean":"2026-02-13T08:14:07.007509+0000","last_became_active":"2026-02-13T08:05:46.332174+0000","last_became_peered":"2026-02-13T08:05:46.332174+0000","last_unstale":"2026-02-13T08:14:07.007509+0000","last_undegraded":"2026-02-13T08:14:07.007509+0000","last_fullsized":"2026-02-13T08:14:07.007509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"323'3","last_scrub_stamp":"2026-02-13T08:14:07.007465+0000","last_deep_scrub":"323'3","last_deep_scrub_stamp":"2026-02-13T08:14:07.007465+0000","last_clean_scrub_stamp":"2026-02-13T08:14:07.007465+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:01:37.731310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000284605,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":612,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:07.879716+0000","last_change":"2026-02-13T08:14:07.879716+0000","last_active":"2026-02-13T08:14:07.879716+0000","last_peered":"2026-02-13T08:14:07.879716+0000","last_clean":"2026-02-13T08:14:07.879716+0000","last_became_active":"2026-02-13T08:06:16.674970+0000","last_became_peered":"2026-02-13T08:06:16.674970+0000","last_unstale":"2026-02-13T08:14:07.879716+0000","last_undegraded":"2026-02-13T08:14:07.879716+0000","last_fullsized":"2026-02-13T08:14:07.879716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:07.879660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:07.879660+0000","last_clean_scrub_stamp":"2026-02-13T08:14:07.879660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:28:32.636858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":627,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:05.711325+0000","last_change":"2026-02-13T08:14:05.711282+0000","last_active":"2026-02-13T08:14:05.711325+0000","last_peered":"2026-02-13T08:14:05.711325+0000","last_clean":"2026-02-13T08:14:05.711325+0000","last_became_active":"2026-02-13T08:05:46.236660+0000","last_became_peered":"2026-02-13T08:05:46.236660+0000","last_unstale":"2026-02-13T08:14:05.711325+0000","last_undegraded":"2026-02-13T08:14:05.711325+0000","last_fullsized":"2026-02-13T08:14:05.711325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:05.711218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:05.711218+0000","last_clean_scrub_stamp":"2026-02-13T08:14:05.711218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:35:20.510755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00024995099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":613,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:05.814857+0000","last_change":"2026-02-13T08:14:05.814857+0000","last_active":"2026-02-13T08:14:05.814857+0000","last_peered":"2026-02-13T08:14:05.814857+0000","last_clean":"2026-02-13T08:14:05.814857+0000","last_became_active":"2026-02-13T08:06:16.775702+0000","last_became_peered":"2026-02-13T08:06:16.775702+0000","last_unstale":"2026-02-13T08:14:05.814857+0000","last_undegraded":"2026-02-13T08:14:05.814857+0000","last_fullsized":"2026-02-13T08:14:05.814857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:05.814795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:05.814795+0000","last_clean_scrub_stamp":"2026-02-13T08:14:05.814795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:36:05.028668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":640,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:08.722384+0000","last_change":"2026-02-13T08:14:08.722384+0000","last_active":"2026-02-13T08:14:08.722384+0000","last_peered":"2026-02-13T08:14:08.722384+0000","last_clean":"2026-02-13T08:14:08.722384+0000","last_became_active":"2026-02-13T08:05:46.331895+0000","last_became_peered":"2026-02-13T08:05:46.331895+0000","last_unstale":"2026-02-13T08:14:08.722384+0000","last_undegraded":"2026-02-13T08:14:08.722384+0000","last_fullsized":"2026-02-13T08:14:08.722384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:08.722328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:08.722328+0000","last_clean_scrub_stamp":"2026-02-13T08:14:08.722328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:34:10.818444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041430500000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":612,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:06.894059+0000","last_change":"2026-02-13T08:14:06.894059+0000","last_active":"2026-02-13T08:14:06.894059+0000","last_peered":"2026-02-13T08:14:06.894059+0000","last_clean":"2026-02-13T08:14:06.894059+0000","last_became_active":"2026-02-13T08:06:16.677657+0000","last_became_peered":"2026-02-13T08:06:16.677657+0000","last_unstale":"2026-02-13T08:14:06.894059+0000","last_undegraded":"2026-02-13T08:14:06.894059+0000","last_fullsized":"2026-02-13T08:14:06.894059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:06.894008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:06.894008+0000","last_clean_scrub_stamp":"2026-02-13T08:14:06.894008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:40:31.776398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"323'2","reported_seq":632,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:07.975677+0000","last_change":"2026-02-13T08:14:07.975677+0000","last_active":"2026-02-13T08:14:07.975677+0000","last_peered":"2026-02-13T08:14:07.975677+0000","last_clean":"2026-02-13T08:14:07.975677+0000","last_became_active":"2026-02-13T08:05:46.331985+0000","last_became_peered":"2026-02-13T08:05:46.331985+0000","last_unstale":"2026-02-13T08:14:07.975677+0000","last_undegraded":"2026-02-13T08:14:07.975677+0000","last_fullsized":"2026-02-13T08:14:07.975677+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"323'2","last_scrub_stamp":"2026-02-13T08:14:07.975611+0000","last_deep_scrub":"323'2","last_deep_scrub_stamp":"2026-02-13T08:14:07.975611+0000","last_clean_scrub_stamp":"2026-02-13T08:14:07.975611+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:40:12.185927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00030744700000000003,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"323'114","reported_seq":780,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:06.646423+0000","last_change":"2026-02-13T08:14:06.646423+0000","last_active":"2026-02-13T08:14:06.646423+0000","last_peered":"2026-02-13T08:14:06.646423+0000","last_clean":"2026-02-13T08:14:06.646423+0000","last_became_active":"2026-02-13T08:05:43.032364+0000","last_became_peered":"2026-02-13T08:05:43.032364+0000","last_unstale":"2026-02-13T08:14:06.646423+0000","last_undegraded":"2026-02-13T08:14:06.646423+0000","last_fullsized":"2026-02-13T08:14:06.646423+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"323'114","last_scrub_stamp":"2026-02-13T08:14:06.646343+0000","last_deep_scrub":"323'114","last_deep_scrub_stamp":"2026-02-13T08:14:06.646343+0000","last_clean_scrub_stamp":"2026-02-13T08:14:06.646343+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:23:15.633229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":626,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:11.672562+0000","last_change":"2026-02-13T08:14:11.672562+0000","last_active":"2026-02-13T08:14:11.672562+0000","last_peered":"2026-02-13T08:14:11.672562+0000","last_clean":"2026-02-13T08:14:11.672562+0000","last_became_active":"2026-02-13T08:06:16.772994+0000","last_became_peered":"2026-02-13T08:06:16.772994+0000","last_unstale":"2026-02-13T08:14:11.672562+0000","last_undegraded":"2026-02-13T08:14:11.672562+0000","last_fullsized":"2026-02-13T08:14:11.672562+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:11.672488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:11.672488+0000","last_clean_scrub_stamp":"2026-02-13T08:14:11.672488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:12:24.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":613,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:08.733280+0000","last_change":"2026-02-13T08:14:08.733280+0000","last_active":"2026-02-13T08:14:08.733280+0000","last_peered":"2026-02-13T08:14:08.733280+0000","last_clean":"2026-02-13T08:14:08.733280+0000","last_became_active":"2026-02-13T08:06:16.784923+0000","last_became_peered":"2026-02-13T08:06:16.784923+0000","last_unstale":"2026-02-13T08:14:08.733280+0000","last_undegraded":"2026-02-13T08:14:08.733280+0000","last_fullsized":"2026-02-13T08:14:08.733280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:08.733227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:08.733227+0000","last_clean_scrub_stamp":"2026-02-13T08:14:08.733227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:15:31.754935+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":613,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:09.683316+0000","last_change":"2026-02-13T08:14:09.683316+0000","last_active":"2026-02-13T08:14:09.683316+0000","last_peered":"2026-02-13T08:14:09.683316+0000","last_clean":"2026-02-13T08:14:09.683316+0000","last_became_active":"2026-02-13T08:06:16.693128+0000","last_became_peered":"2026-02-13T08:06:16.693128+0000","last_unstale":"2026-02-13T08:14:09.683316+0000","last_undegraded":"2026-02-13T08:14:09.683316+0000","last_fullsized":"2026-02-13T08:14:09.683316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:09.683260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:09.683260+0000","last_clean_scrub_stamp":"2026-02-13T08:14:09.683260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:33:59.741065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":612,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:05.865099+0000","last_change":"2026-02-13T08:14:05.865099+0000","last_active":"2026-02-13T08:14:05.865099+0000","last_peered":"2026-02-13T08:14:05.865099+0000","last_clean":"2026-02-13T08:14:05.865099+0000","last_became_active":"2026-02-13T08:06:16.706496+0000","last_became_peered":"2026-02-13T08:06:16.706496+0000","last_unstale":"2026-02-13T08:14:05.865099+0000","last_undegraded":"2026-02-13T08:14:05.865099+0000","last_fullsized":"2026-02-13T08:14:05.865099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:05.865063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:05.865063+0000","last_clean_scrub_stamp":"2026-02-13T08:14:05.865063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:33:14.143258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":613,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:08.727820+0000","last_change":"2026-02-13T08:14:08.727820+0000","last_active":"2026-02-13T08:14:08.727820+0000","last_peered":"2026-02-13T08:14:08.727820+0000","last_clean":"2026-02-13T08:14:08.727820+0000","last_became_active":"2026-02-13T08:06:16.704582+0000","last_became_peered":"2026-02-13T08:06:16.704582+0000","last_unstale":"2026-02-13T08:14:08.727820+0000","last_undegraded":"2026-02-13T08:14:08.727820+0000","last_fullsized":"2026-02-13T08:14:08.727820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:08.727751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:08.727751+0000","last_clean_scrub_stamp":"2026-02-13T08:14:08.727751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:21:06.658491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":612,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:11.831346+0000","last_change":"2026-02-13T08:14:11.831346+0000","last_active":"2026-02-13T08:14:11.831346+0000","last_peered":"2026-02-13T08:14:11.831346+0000","last_clean":"2026-02-13T08:14:11.831346+0000","last_became_active":"2026-02-13T08:06:16.703565+0000","last_became_peered":"2026-02-13T08:06:16.703565+0000","last_unstale":"2026-02-13T08:14:11.831346+0000","last_undegraded":"2026-02-13T08:14:11.831346+0000","last_fullsized":"2026-02-13T08:14:11.831346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:11.831288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:11.831288+0000","last_clean_scrub_stamp":"2026-02-13T08:14:11.831288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:23:23.932431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":613,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:07.703502+0000","last_change":"2026-02-13T08:14:07.703502+0000","last_active":"2026-02-13T08:14:07.703502+0000","last_peered":"2026-02-13T08:14:07.703502+0000","last_clean":"2026-02-13T08:14:07.703502+0000","last_became_active":"2026-02-13T08:06:16.714959+0000","last_became_peered":"2026-02-13T08:06:16.714959+0000","last_unstale":"2026-02-13T08:14:07.703502+0000","last_undegraded":"2026-02-13T08:14:07.703502+0000","last_fullsized":"2026-02-13T08:14:07.703502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:07.703426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:07.703426+0000","last_clean_scrub_stamp":"2026-02-13T08:14:07.703426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:51:03.592117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":616,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:08.582152+0000","last_change":"2026-02-13T08:14:08.582152+0000","last_active":"2026-02-13T08:14:08.582152+0000","last_peered":"2026-02-13T08:14:08.582152+0000","last_clean":"2026-02-13T08:14:08.582152+0000","last_became_active":"2026-02-13T08:06:16.706451+0000","last_became_peered":"2026-02-13T08:06:16.706451+0000","last_unstale":"2026-02-13T08:14:08.582152+0000","last_undegraded":"2026-02-13T08:14:08.582152+0000","last_fullsized":"2026-02-13T08:14:08.582152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:08.582093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:08.582093+0000","last_clean_scrub_stamp":"2026-02-13T08:14:08.582093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T19:06:49.259805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":616,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:07.562632+0000","last_change":"2026-02-13T08:14:07.562632+0000","last_active":"2026-02-13T08:14:07.562632+0000","last_peered":"2026-02-13T08:14:07.562632+0000","last_clean":"2026-02-13T08:14:07.562632+0000","last_became_active":"2026-02-13T08:06:16.737141+0000","last_became_peered":"2026-02-13T08:06:16.737141+0000","last_unstale":"2026-02-13T08:14:07.562632+0000","last_undegraded":"2026-02-13T08:14:07.562632+0000","last_fullsized":"2026-02-13T08:14:07.562632+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:07.562566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:07.562566+0000","last_clean_scrub_stamp":"2026-02-13T08:14:07.562566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:11:31.850967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":626,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:13.725963+0000","last_change":"2026-02-13T08:14:13.725963+0000","last_active":"2026-02-13T08:14:13.725963+0000","last_peered":"2026-02-13T08:14:13.725963+0000","last_clean":"2026-02-13T08:14:13.725963+0000","last_became_active":"2026-02-13T08:06:16.791964+0000","last_became_peered":"2026-02-13T08:06:16.791964+0000","last_unstale":"2026-02-13T08:14:13.725963+0000","last_undegraded":"2026-02-13T08:14:13.725963+0000","last_fullsized":"2026-02-13T08:14:13.725963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:13.725890+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:13.725890+0000","last_clean_scrub_stamp":"2026-02-13T08:14:13.725890+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T18:25:11.131521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":613,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:07.766911+0000","last_change":"2026-02-13T08:14:07.766911+0000","last_active":"2026-02-13T08:14:07.766911+0000","last_peered":"2026-02-13T08:14:07.766911+0000","last_clean":"2026-02-13T08:14:07.766911+0000","last_became_active":"2026-02-13T08:06:16.764042+0000","last_became_peered":"2026-02-13T08:06:16.764042+0000","last_unstale":"2026-02-13T08:14:07.766911+0000","last_undegraded":"2026-02-13T08:14:07.766911+0000","last_fullsized":"2026-02-13T08:14:07.766911+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:07.766844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:07.766844+0000","last_clean_scrub_stamp":"2026-02-13T08:14:07.766844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T17:28:13.062356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":614,"reported_epoch":323,"state":"active+clean","last_fresh":"2026-02-13T08:14:11.018800+0000","last_change":"2026-02-13T08:14:11.018800+0000","last_active":"2026-02-13T08:14:11.018800+0000","last_peered":"2026-02-13T08:14:11.018800+0000","last_clean":"2026-02-13T08:14:11.018800+0000","last_became_active":"2026-02-13T08:06:16.799194+0000","last_became_peered":"2026-02-13T08:06:16.799194+0000","last_unstale":"2026-02-13T08:14:11.018800+0000","last_undegraded":"2026-02-13T08:14:11.018800+0000","last_fullsized":"2026-02-13T08:14:11.018800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T08:14:11.018741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T08:14:11.018741+0000","last_clean_scrub_stamp":"2026-02-13T08:14:11.018741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T16:51:41.141064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":11,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":1180736,"data_compressed":24880,"data_compressed_allocated":98304,"data_compressed_original":1180736,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640362,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":4613,"kb_used_meta":58426,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409441,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":4724473,"internal_metadata":59828487},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640362,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":3011,"kb_used_meta":60028,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409427,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":3083702,"internal_metadata":61469258},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640362,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66756,"kb_used_data":3700,"kb_used_omap":3015,"kb_used_meta":60024,"kb_avail":94305084,"statfs":{"total":96636764160,"available":96568406016,"internally_reserved":0,"allocated":3788800,"data_stored":2999790,"data_compressed":663918,"data_compressed_allocated":1351680,"data_compressed_original":2514840,"omap_allocated":3088323,"internal_metadata":61464637},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640362,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66708,"kb_used_data":3652,"kb_used_omap":2924,"kb_used_meta":60115,"kb_avail":94305132,"statfs":{"total":96636764160,"available":96568455168,"internally_reserved":0,"allocated":3739648,"data_stored":2409422,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":2994630,"internal_metadata":61558330},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640363,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66712,"kb_used_data":3656,"kb_used_omap":5013,"kb_used_meta":58026,"kb_avail":94305128,"statfs":{"total":96636764160,"available":96568451072,"internally_reserved":0,"allocated":3743744,"data_stored":2409441,"data_compressed":651478,"data_compressed_allocated":1302528,"data_compressed_original":1924472,"omap_allocated":5134330,"internal_metadata":59418630},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640362,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66760,"kb_used_data":3704,"kb_used_omap":2523,"kb_used_meta":60516,"kb_avail":94305080,"statfs":{"total":96636764160,"available":96568401920,"internally_reserved":0,"allocated":3792896,"data_stored":2999795,"data_compressed":663918,"data_compressed_allocated":1351680,"data_compressed_original":2514840,"omap_allocated":2583910,"internal_metadata":61969050},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":12440,"data_compressed_allocated":49152,"data_compressed_original":590368,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T08:14:26.413 DEBUG:teuthology.orchestra.run.trial104:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-13T08:14:26.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient: get_monmap_and_config 2026-02-13T08:14:26.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient: build_initial_monmap 2026-02-13T08:14:26.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient: monmap: 2026-02-13T08:14:26.473 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:26.473 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.473 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:14:26.468890+0000 2026-02-13T08:14:26.473 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:14:26.468890+0000 2026-02-13T08:14:26.473 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:26.473 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.473 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:26.473 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-c 2026-02-13T08:14:26.473 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-b 2026-02-13T08:14:26.473 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 Processor -- start 2026-02-13T08:14:26.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 -- start start 2026-02-13T08:14:26.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient: init 2026-02-13T08:14:26.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:26.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient: _add_conns ranks=[0,1,2] 2026-02-13T08:14:26.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient(hunting): picked mon.noname-a con 0x7f8324139f20 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:26.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient(hunting): picked mon.noname-c con 0x7f832415e200 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:26.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient(hunting): picked mon.noname-b con 0x7f832417fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:26.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f832413aa00 con 0x7f8324139f20 2026-02-13T08:14:26.481 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f832408ba20 con 0x7f832415e200 2026-02-13T08:14:26.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8324089e30 con 0x7f832417fd00 2026-02-13T08:14:26.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:26.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient(hunting): authenticate will time out at 972.058046s 2026-02-13T08:14:26.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832982b640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f8324139f20 0x7f832413a2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:46628/0 (socket says 10.20.193.104:46628) 2026-02-13T08:14:26.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832982b640 1 -- 10.20.193.104:0/2201511562 learned_addr learned my addr 10.20.193.104:0/2201511562 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:26.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 -- 10.20.193.104:0/2201511562 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 530275699 0 0) 0x7f8314002920 con 0x7f8324139f20 2026-02-13T08:14:26.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient(hunting): _negotiate 2026-02-13T08:14:26.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:26.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:26.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient(hunting): my global_id is 94338 2026-02-13T08:14:26.482 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 -- 10.20.193.104:0/2201511562 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f830c003620 con 0x7f8324139f20 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 -- 10.20.193.104:0/2201511562 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 195277212 0 0) 0x7f8324089e30 con 0x7f832417fd00 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient(hunting): _negotiate 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient(hunting): my global_id is 104249 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 -- 10.20.193.104:0/2201511562 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8314002920 con 0x7f832417fd00 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 -- 10.20.193.104:0/2201511562 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1093984738 0 0) 0x7f830c003620 con 0x7f8324139f20 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 -- 10.20.193.104:0/2201511562 >> v1:10.20.193.104:6790/0 conn(0x7f832417fd00 legacy=0x7f83241a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 -- 10.20.193.104:0/2201511562 >> v1:10.20.193.119:6789/0 conn(0x7f832415e200 legacy=0x7f832417e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient: _finish_hunting 0 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 monclient: found mon.noname-a 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:26.483 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient: _send_mon_message to mon.noname-a at v1:10.20.193.104:6789/0 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 -- 10.20.193.104:0/2201511562 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832408a380 con 0x7f8324139f20 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient: _finish_auth 0 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient: _check_auth_tickets 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 -- 10.20.193.104:0/2201511562 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f8314002fd0 con 0x7f8324139f20 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 5 monclient: authenticate success, global_id 94338 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient: dump: 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:26.484 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 -- 10.20.193.104:0/2201511562 <== mon.0 v1:10.20.193.104:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8314003220 con 0x7f8324139f20 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 1 -- 10.20.193.104:0/2201511562 <== mon.0 v1:10.20.193.104:6789/0 5 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f83140049a0 con 0x7f8324139f20 2026-02-13T08:14:26.485 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f8328829640 10 monclient: dump: 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:26.486 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient: get_monmap_and_config success 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 4 set_mon_vals no callback set 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient: shutdown 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 -- 10.20.193.104:0/2201511562 >> v1:10.20.193.104:6789/0 conn(0x7f8324139f20 legacy=0x7f832413a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 -- 10.20.193.104:0/2201511562 shutdown_connections 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 -- 10.20.193.104:0/2201511562 >> 10.20.193.104:0/2201511562 conn(0x7f8324051a50 msgr2=0x7f8324051e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 -- 10.20.193.104:0/2201511562 shutdown_connections 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 -- 10.20.193.104:0/2201511562 wait complete. 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient: build_initial_monmap 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient: monmap: 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:epoch 0 2026-02-13T08:14:26.487 INFO:teuthology.orchestra.run.trial104.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 0.000000 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr:created 0.000000 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 0 (unknown) 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.noname-a 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.noname-b 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.noname-c 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 librados: starting msgr at 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 librados: starting objecter 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 Processor -- start 2026-02-13T08:14:26.488 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 -- start start 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 librados: setting wanted keys 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 1 librados: calling monclient init 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.467+0000 7f832bab6640 10 monclient: init 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient: _reopen_session rank -1 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient: _add_conns ranks=[1,0,2] 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient(hunting): picked mon.noname-b con 0x7f8324139f20 addr v1:10.20.193.119:6789/0 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient(hunting): picked mon.noname-a con 0x7f832415e200 addr v1:10.20.193.104:6789/0 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient(hunting): picked mon.noname-c con 0x7f832417fd00 addr v1:10.20.193.104:6790/0 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 1 -- --> v1:10.20.193.104:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83240883d0 con 0x7f832415e200 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 1 -- --> v1:10.20.193.119:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f832405cc40 con 0x7f8324139f20 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 1 -- --> v1:10.20.193.104:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f832413c750 con 0x7f832417fd00 2026-02-13T08:14:26.489 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient(hunting): _renew_subs 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient(hunting): authenticate will time out at 972.060437s 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832902a640 1 --1- >> v1:10.20.193.104:6789/0 conn(0x7f832415e200 0x7f8324125a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:10.20.193.104:6789/0 says I am v1:10.20.193.104:46644/0 (socket says 10.20.193.104:46644) 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832902a640 1 -- 10.20.193.104:0/1834562859 learned_addr learned my addr 10.20.193.104:0/1834562859 (peer_addr_for_me v1:10.20.193.104:0/0) 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 client.?.objecter ms_handle_connect 0x7f832415e200 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 client.?.objecter ms_handle_connect 0x7f832417fd00 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.0 v1:10.20.193.104:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600270729 0 0) 0x7f83240883d0 con 0x7f832415e200 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:26.490 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): my global_id is 94341 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 --> v1:10.20.193.104:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f4003620 con 0x7f832415e200 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.2 v1:10.20.193.104:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168475700 0 0) 0x7f832413c750 con 0x7f832417fd00 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): _negotiate 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): _init_auth method 2 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): my global_id is 104252 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 --> v1:10.20.193.104:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83240883d0 con 0x7f832417fd00 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.0 v1:10.20.193.104:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1374403957 0 0) 0x7f82f4003620 con 0x7f832415e200 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 --> v1:10.20.193.104:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f832413c750 con 0x7f832415e200 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 client.?.objecter ms_handle_connect 0x7f8324139f20 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 client.?.objecter resend_mon_ops 2026-02-13T08:14:26.491 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.0 v1:10.20.193.104:6789/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f83180040b0 con 0x7f832415e200 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): dump: 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:26.492 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): _finish_auth 0 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.2 v1:10.20.193.104:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1480276496 0 0) 0x7f83240883d0 con 0x7f832417fd00 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 --> v1:10.20.193.104:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82f4003620 con 0x7f832417fd00 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.2 v1:10.20.193.104:6790/0 3 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f8320003550 con 0x7f832417fd00 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient(hunting): dump: 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:26.493 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.0 v1:10.20.193.104:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4201892037 0 0) 0x7f832413c750 con 0x7f832415e200 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 >> v1:10.20.193.104:6790/0 conn(0x7f832417fd00 legacy=0x7f83241271b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 >> v1:10.20.193.119:6789/0 conn(0x7f8324139f20 legacy=0x7f8324087410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient: _finish_hunting 0 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 monclient: found mon.a 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:26.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 --> v1:10.20.193.104:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8324086620 con 0x7f832415e200 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient: _finish_auth 0 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient: _check_auth_tickets 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 5 monclient: authenticate success, global_id 94341 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient: _renew_subs 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 1 -- 10.20.193.104:0/1834562859 --> v1:10.20.193.104:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8324164e70 con 0x7f832415e200 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 client.94341.objecter _maybe_request_map subscribing (onetime) to next osd map 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient: _renew_subs 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 1 -- 10.20.193.104:0/1834562859 --> v1:10.20.193.104:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8324163bb0 con 0x7f832415e200 2026-02-13T08:14:26.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 1 librados: init done 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.0 v1:10.20.193.104:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f83180026e0 con 0x7f832415e200 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient: handle_config config(0 keys) 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.0 v1:10.20.193.104:6789/0 6 ==== mon_map magic: 0 ==== 308+0+0 (unknown 3054614008 0 0) 0x7f8318002910 con 0x7f832415e200 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient: dump: 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:epoch 1 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:fsid 0e1d0140-145d-4ea8-a799-1ca564383c2b 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:last_changed 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:created 2026-02-13T08:05:17.826446+0000 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:min_mon_release 20 (tentacle) 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:election_strategy: 1 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:0: v1:10.20.193.104:6789/0 mon.a 2026-02-13T08:14:26.496 INFO:teuthology.orchestra.run.trial104.stderr:1: v1:10.20.193.119:6789/0 mon.b 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr:2: v1:10.20.193.104:6790/0 mon.c 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f8313fff640 4 set_mon_vals no callback set 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.0 v1:10.20.193.104:6789/0 7 ==== mgrmap(e 5) ==== 48730+0+0 (unknown 2644540691 0 0) 0x7f8318002ab0 con 0x7f832415e200 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832bab6640 1 -- 10.20.193.104:0/1834562859 --> v1:10.20.193.104:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8324164990 con 0x7f832415e200 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.0 v1:10.20.193.104:6789/0 8 ==== osd_map(323..323 src has 1..323) ==== 4365+0+0 (unknown 580926549 0 0) 0x7f831804a470 con 0x7f832415e200 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 client.94341.objecter ms_dispatch2 0x7f8324000ba0 osd_map(323..323 src has 1..323) 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 3 client.94341.objecter handle_osd_map got epochs [323,323] > 0 2026-02-13T08:14:26.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 3 client.94341.objecter handle_osd_map decoding full epoch 323 2026-02-13T08:14:26.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 20 client.94341.objecter dump_active .. 0 homeless 2026-02-13T08:14:26.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f832982b640 10 monclient: get_auth_request con 0x7f82f403b8a0 auth_method 0 2026-02-13T08:14:26.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 client.94341.objecter ms_handle_connect 0x7f82f403b8a0 2026-02-13T08:14:26.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.0 v1:10.20.193.104:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+199252 (unknown 1092875540 0 1160193618) 0x7f8318016bf0 con 0x7f832415e200 2026-02-13T08:14:26.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-13T08:14:26.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.471+0000 7f83127fc640 10 monclient: _finish_command 1 = system:0 2026-02-13T08:14:26.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.555+0000 7f832bab6640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-13T08:14:26.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.555+0000 7f832bab6640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-13T08:14:26.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.555+0000 7f832bab6640 10 monclient: _send_mon_message to mon.a at v1:10.20.193.104:6789/0 2026-02-13T08:14:26.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.555+0000 7f832bab6640 1 -- 10.20.193.104:0/1834562859 --> v1:10.20.193.104:6789/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f83240380f0 con 0x7f832415e200 2026-02-13T08:14:26.564 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.0 v1:10.20.193.104:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (unknown 691139944 0 0) 0x7f83180164f0 con 0x7f832415e200 2026-02-13T08:14:26.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f83127fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-13T08:14:26.565 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f83127fc640 10 monclient: _finish_command 2 = system:0 2026-02-13T08:14:26.566 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f83127fc640 1 -- 10.20.193.104:0/1834562859 <== mon.0 v1:10.20.193.104:6789/0 11 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7f831801bb10 con 0x7f832415e200 2026-02-13T08:14:26.566 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f83127fc640 10 monclient: handle_config config(1 keys) 2026-02-13T08:14:26.566 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f83137fe640 4 set_mon_vals no callback set 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f83137fe640 10 set_mon_vals mon_health_to_clog = false 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 10 librados: watch_flush enter 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 10 librados: watch_flush exit 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 20 client.94341.objecter shutdown clearing up homeless session... 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 10 client.94341.objecter successfully canceled tick 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 1 -- 10.20.193.104:0/1834562859 >> v1:10.20.193.119:6812/276487904 conn(0x7f82f403b8a0 legacy=0x7f82f405bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 10 monclient: shutdown 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 1 -- 10.20.193.104:0/1834562859 >> v1:10.20.193.104:6789/0 conn(0x7f832415e200 legacy=0x7f8324125a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 1 -- 10.20.193.104:0/1834562859 shutdown_connections 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 1 -- 10.20.193.104:0/1834562859 >> 10.20.193.104:0/1834562859 conn(0x7f8324051a50 msgr2=0x7f832413abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T08:14:26.567 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 1 -- 10.20.193.104:0/1834562859 shutdown_connections 2026-02-13T08:14:26.568 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 1 -- 10.20.193.104:0/1834562859 wait complete. 2026-02-13T08:14:26.568 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-13T08:14:26.559+0000 7f832bab6640 1 librados: shutdown 2026-02-13T08:14:26.576 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-13T08:14:26.577 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-13T08:14:26.577 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-13T08:14:26.577 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:14:26.654 INFO:tasks.ceph.osd.0:Stopped 2026-02-13T08:14:26.654 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-13T08:14:26.654 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:14:26.742 INFO:tasks.ceph.osd.1:Stopped 2026-02-13T08:14:26.743 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-13T08:14:26.743 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:14:26.832 INFO:tasks.ceph.osd.2:Stopped 2026-02-13T08:14:26.832 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-13T08:14:26.833 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:14:26.913 INFO:tasks.ceph.osd.3:Stopped 2026-02-13T08:14:26.913 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-13T08:14:26.913 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:14:29.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2026-02-13T08:14:33.015 INFO:tasks.ceph.osd.4:Stopped 2026-02-13T08:14:33.015 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-13T08:14:33.015 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:14:33.084 INFO:tasks.ceph.osd.5:Stopped 2026-02-13T08:14:33.084 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-13T08:14:33.085 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-13T08:14:33.085 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:14:33.112 INFO:tasks.ceph.mgr.x:Stopped 2026-02-13T08:14:33.113 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-13T08:14:33.113 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-13T08:14:33.113 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:14:33.128 INFO:tasks.ceph.mon.a:Stopped 2026-02-13T08:14:33.128 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-13T08:14:33.129 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:14:33.185 INFO:tasks.ceph.mon.c:Stopped 2026-02-13T08:14:33.185 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-13T08:14:33.185 INFO:teuthology.orchestra.run:waiting for 300 2026-02-13T08:14:33.201 INFO:tasks.ceph.mon.b:Stopped 2026-02-13T08:14:33.201 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-13T08:14:33.201 DEBUG:teuthology.orchestra.run.trial104:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'slow request' | head -n 1 2026-02-13T08:14:33.238 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial104.front.sepia.ceph.com 2026-02-13T08:14:33.239 DEBUG:teuthology.orchestra.run.trial104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-13T08:14:33.294 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial104.front.sepia.ceph.com 2026-02-13T08:14:33.294 DEBUG:teuthology.orchestra.run.trial104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-13T08:14:33.348 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial104.front.sepia.ceph.com 2026-02-13T08:14:33.348 DEBUG:teuthology.orchestra.run.trial104:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-13T08:14:33.403 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial119.front.sepia.ceph.com 2026-02-13T08:14:33.403 DEBUG:teuthology.orchestra.run.trial119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-13T08:14:33.436 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial119.front.sepia.ceph.com 2026-02-13T08:14:33.436 DEBUG:teuthology.orchestra.run.trial119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-13T08:14:33.492 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial119.front.sepia.ceph.com 2026-02-13T08:14:33.492 DEBUG:teuthology.orchestra.run.trial119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-13T08:14:33.548 INFO:tasks.ceph:Archiving mon data... 2026-02-13T08:14:33.549 DEBUG:teuthology.misc:Transferring archived files from trial104:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874/data/mon.a.tgz 2026-02-13T08:14:33.549 DEBUG:teuthology.orchestra.run.trial104:> mktemp 2026-02-13T08:14:33.554 INFO:teuthology.orchestra.run.trial104.stdout:/tmp/tmp.7g5hWIFjkb 2026-02-13T08:14:33.555 DEBUG:teuthology.orchestra.run.trial104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.7g5hWIFjkb 2026-02-13T08:14:33.638 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod 0666 /tmp/tmp.7g5hWIFjkb 2026-02-13T08:14:33.737 DEBUG:teuthology.orchestra.remote:trial104:/tmp/tmp.7g5hWIFjkb is 341KB 2026-02-13T08:14:33.793 DEBUG:teuthology.orchestra.run.trial104:> rm -fr /tmp/tmp.7g5hWIFjkb 2026-02-13T08:14:33.798 DEBUG:teuthology.misc:Transferring archived files from trial104:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874/data/mon.c.tgz 2026-02-13T08:14:33.798 DEBUG:teuthology.orchestra.run.trial104:> mktemp 2026-02-13T08:14:33.842 INFO:teuthology.orchestra.run.trial104.stdout:/tmp/tmp.ZWfIDUHwAn 2026-02-13T08:14:33.843 DEBUG:teuthology.orchestra.run.trial104:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ZWfIDUHwAn 2026-02-13T08:14:33.936 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod 0666 /tmp/tmp.ZWfIDUHwAn 2026-02-13T08:14:33.992 DEBUG:teuthology.orchestra.remote:trial104:/tmp/tmp.ZWfIDUHwAn is 339KB 2026-02-13T08:14:34.049 DEBUG:teuthology.orchestra.run.trial104:> rm -fr /tmp/tmp.ZWfIDUHwAn 2026-02-13T08:14:34.053 DEBUG:teuthology.misc:Transferring archived files from trial119:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874/data/mon.b.tgz 2026-02-13T08:14:34.053 DEBUG:teuthology.orchestra.run.trial119:> mktemp 2026-02-13T08:14:34.058 INFO:teuthology.orchestra.run.trial119.stdout:/tmp/tmp.8nf6iFc7qE 2026-02-13T08:14:34.059 DEBUG:teuthology.orchestra.run.trial119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.8nf6iFc7qE 2026-02-13T08:14:34.142 DEBUG:teuthology.orchestra.run.trial119:> sudo chmod 0666 /tmp/tmp.8nf6iFc7qE 2026-02-13T08:14:34.244 DEBUG:teuthology.orchestra.remote:trial119:/tmp/tmp.8nf6iFc7qE is 345KB 2026-02-13T08:14:34.300 DEBUG:teuthology.orchestra.run.trial119:> rm -fr /tmp/tmp.8nf6iFc7qE 2026-02-13T08:14:34.305 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-13T08:14:34.305 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-13T08:14:34.307 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-13T08:14:34.359 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-13T08:14:34.398 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-13T08:14:34.399 INFO:tasks.ceph:Archiving crash dumps... 2026-02-13T08:14:34.401 DEBUG:teuthology.misc:Transferring archived files from trial104:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874/remote/trial104/crash 2026-02-13T08:14:34.402 DEBUG:teuthology.orchestra.run.trial104:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-13T08:14:34.412 DEBUG:teuthology.misc:Transferring archived files from trial119:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874/remote/trial119/crash 2026-02-13T08:14:34.413 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-13T08:14:34.447 INFO:tasks.ceph:Compressing logs... 2026-02-13T08:14:34.447 DEBUG:teuthology.orchestra.run.trial104:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T08:14:34.456 DEBUG:teuthology.orchestra.run.trial119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T08:14:34.463 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14280.log 2026-02-13T08:14:34.465 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14728.log 2026-02-13T08:14:34.465 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16584.log 2026-02-13T08:14:34.465 INFO:teuthology.orchestra.run.trial104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.14280.log.gz 2026-02-13T08:14:34.465 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16272.log 2026-02-13T08:14:34.465 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14728.log: /var/log/ceph/ceph-client.admin.16584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14275.log 2026-02-13T08:14:34.465 INFO:teuthology.orchestra.run.trial104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.16584.log.gz 2026-02-13T08:14:34.465 INFO:teuthology.orchestra.run.trial104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.14728.log.gz 2026-02-13T08:14:34.465 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15594.log 2026-02-13T08:14:34.472 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14806.log 2026-02-13T08:14:34.473 INFO:teuthology.orchestra.run.trial104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.16272.log.gz 2026-02-13T08:14:34.473 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16870.log 2026-02-13T08:14:34.473 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15594.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.14275.log.gz 2026-02-13T08:14:34.473 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16376.log 2026-02-13T08:14:34.473 INFO:teuthology.orchestra.run.trial104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.15594.log.gz 2026-02-13T08:14:34.473 INFO:teuthology.orchestra.run.trial104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.14806.log.gz 2026-02-13T08:14:34.473 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17104.log 2026-02-13T08:14:34.473 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16948.log 2026-02-13T08:14:34.473 INFO:teuthology.orchestra.run.trial104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.16870.log.gz 2026-02-13T08:14:34.473 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.17104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13980.log 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.16376.log.gz 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13955.log 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16948.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.17104.log.gz 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.13980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16740.log 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.13955.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.16948.log.gz 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14120.log 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.13980.log.gz 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.13955.log.gz 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14416.log 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17052.log 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14120.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.16740.log.gz 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16922.log 2026-02-13T08:14:34.474 INFO:teuthology.orchestra.run.trial104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.14416.log.gz 2026-02-13T08:14:34.475 INFO:teuthology.orchestra.run.trial104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.14120.log.gz 2026-02-13T08:14:34.475 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.17052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14937.log 2026-02-13T08:14:34.475 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.13930.log 2026-02-13T08:14:34.475 INFO:teuthology.orchestra.run.trial104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.17052.log.gz 2026-02-13T08:14:34.475 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14885.log 2026-02-13T08:14:34.475 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14937.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.16922.log.gz 2026-02-13T08:14:34.475 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.13930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14572.log 2026-02-13T08:14:34.475 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14885.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.13930.log.gz 2026-02-13T08:14:34.475 INFO:teuthology.orchestra.run.trial104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.14937.log.gz 2026-02-13T08:14:34.475 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16792.log 2026-02-13T08:14:34.476 INFO:teuthology.orchestra.run.trial104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.14885.log.gz 2026-02-13T08:14:34.476 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14434.log 2026-02-13T08:14:34.476 INFO:teuthology.orchestra.run.trial104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.14572.log.gz 2026-02-13T08:14:34.476 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15910.log 2026-02-13T08:14:34.476 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14676.log 2026-02-13T08:14:34.476 INFO:teuthology.orchestra.run.trial104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.16792.log.gz 2026-02-13T08:14:34.476 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15910.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.14434.log.gz 2026-02-13T08:14:34.476 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14052.log 2026-02-13T08:14:34.476 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.14676.log: -- /var/log/ceph/ceph-client.admin.11252.log 2026-02-13T08:14:34.476 INFO:teuthology.orchestra.run.trial104.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.15910.log.gz 2026-02-13T08:14:34.477 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15672.log 2026-02-13T08:14:34.477 INFO:teuthology.orchestra.run.trial104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.14676.log.gz 2026-02-13T08:14:34.477 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.11252.log: gzip -5 87.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.14052.log.gz /var/log/ceph/ceph-client.admin.15462.log 2026-02-13T08:14:34.477 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:34.498 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16532.log 2026-02-13T08:14:34.499 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15672.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.11252.log.gz 2026-02-13T08:14:34.499 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15646.log 2026-02-13T08:14:34.499 INFO:teuthology.orchestra.run.trial104.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.15672.log.gz 2026-02-13T08:14:34.499 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16532.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.15462.log.gz 2026-02-13T08:14:34.499 INFO:teuthology.orchestra.run.trial104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.16324.log 2026-02-13T08:14:34.499 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15646.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.16532.log.gz 2026-02-13T08:14:34.499 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16194.log 2026-02-13T08:14:34.499 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15962.log 2026-02-13T08:14:34.499 INFO:teuthology.orchestra.run.trial104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.15646.log.gz 2026-02-13T08:14:34.499 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.11319.log 2026-02-13T08:14:34.499 INFO:teuthology.orchestra.run.trial104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.16324.log.gz 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15410.log 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.16194.log.gz 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.11319.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.15962.log.gz -5 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr: --verbose -- /var/log/ceph/ceph-client.admin.15830.log 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.11319.log.gz 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15410.log: /var/log/ceph/ceph-client.admin.15830.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.15410.log.gz 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.15384.log 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14858.log 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.15830.log.gz 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16558.log 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15384.log: /var/log/ceph/ceph-client.admin.14858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14754.log 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.14858.log.gz 2026-02-13T08:14:34.500 INFO:teuthology.orchestra.run.trial104.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.15384.log.gz 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15884.log 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16558.log: /var/log/ceph/ceph-client.admin.14754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17078.log 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.16558.log.gz 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.14754.log.gz 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15988.log 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.15884.log.gz 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.17078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16610.log 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14435.log 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.17078.log.gz 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16428.log 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16610.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.15988.log.gz 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14277.log 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.14435.log.gz 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.16610.log.gz 2026-02-13T08:14:34.501 INFO:teuthology.orchestra.run.trial104.stderr:gzip/var/log/ceph/ceph-client.admin.16428.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.15620.log 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14124.log 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.16428.log.gz 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15620.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.14277.log.gz 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16350.log 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.15620.log.gz 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16662.log 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.14124.log.gz 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16094.log 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14119.log 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.16350.log.gz 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16094.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.16662.log.gz 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16128.log 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14121.log 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14119.log: /var/log/ceph/ceph-client.admin.16128.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.16094.log.gz 2026-02-13T08:14:34.502 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14429.log 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.16128.log.gz 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.14119.log.gz 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16246.log 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14429.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.14121.log.gz 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14276.log 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17026.log 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16246.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.14429.log.gz 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.11463.log 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.14276.log.gz 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.16246.log.gz 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.17026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15752.log 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.11463.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.17026.log.gz 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16974.log 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14911.log 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.11463.log.gz 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16974.log: gzip -5 86.6% --verbose -- /var/log/ceph/ceph-client.admin.17154.log -- replaced with /var/log/ceph/ceph-client.admin.15752.log.gz 2026-02-13T08:14:34.503 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.16974.log.gz 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15936.log 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14911.log: /var/log/ceph/ceph-client.admin.17154.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15936.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.14911.log.gz 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.17154.log.gz 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.15936.log.gz 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14078.log 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16016.log 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14078.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.14078.log.gz 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15516.log 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.16016.log.gz 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.7524.log 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16042.log 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph.tmp-client.admin.7524.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.7524.log.gz 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.15516.log.gz 2026-02-13T08:14:34.504 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16636.log 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14832.log 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.16042.log.gz 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16068.log 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.16636.log.gz 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14123.log 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14278.log 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.14832.log.gz 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14702.log 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14278.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.16068.log.gz 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.14123.log.gz 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17130.log 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.14278.log.gz 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15804.log 2026-02-13T08:14:34.505 INFO:teuthology.orchestra.run.trial104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.14702.log.gz 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.17130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16896.log 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.17130.log.gz 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr: 92.2%/var/log/ceph/ceph-client.admin.15804.log: -- replaced with /var/log/ceph/ceph.log.gz 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14122.log 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.15804.log.gz 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15488.log 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16896.log: /var/log/ceph/ceph-client.admin.14122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15436.log 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.16896.log.gz 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.14122.log.gz 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr:gzip/var/log/ceph/ceph-client.admin.15488.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.14624.log 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.17000.log 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.15488.log.gz 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14624.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.15436.log.gz 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15568.log 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.14624.log.gz 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.17000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16402.log 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16688.log 2026-02-13T08:14:34.506 INFO:teuthology.orchestra.run.trial104.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.17000.log.gz 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14598.log 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16402.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.15568.log.gz 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16714.log 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.16688.log.gz 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.16402.log.gz 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14598.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.14598.log.gz 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14780.log 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16714.log: /var/log/ceph/ceph-client.admin.14780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14436.log 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.16714.log.gz 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.14780.log.gz 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15856.log 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16220.log 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.14436.log.gz 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16844.log 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.15856.log.gz 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15542.log 2026-02-13T08:14:34.507 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16844.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-13T08:14:34.508 INFO:teuthology.orchestra.run.trial104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.16220.log.gz 2026-02-13T08:14:34.508 INFO:teuthology.orchestra.run.trial104.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.16844.log.gz 2026-02-13T08:14:34.508 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15778.log 2026-02-13T08:14:34.508 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14000.log 2026-02-13T08:14:34.508 INFO:teuthology.orchestra.run.trial104.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.15542.log.gz 2026-02-13T08:14:34.512 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.15778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16454.log 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14000.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.15778.log.gz 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14026.log 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16766.log 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.14000.log.gz 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14026.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.16454.log.gz 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14650.log 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.11276.log 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16766.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.14026.log.gz 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16298.log 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.16766.log.gz 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.11276.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.14650.log.gz 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.16818.log 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.11276.log.gz 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14432.log 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.16298.log.gz 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.16818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14279.log 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14432.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.16818.log.gz 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.14432.log.gz 2026-02-13T08:14:34.513 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.admin.14279.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.14279.log.gz 2026-02-13T08:14:34.519 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15288.log 2026-02-13T08:14:34.519 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14817.log 2026-02-13T08:14:34.519 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15342.log 2026-02-13T08:14:34.519 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-13T08:14:34.519 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14817.log: /var/log/ceph/ceph-client.admin.15342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14838.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15508.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14516.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.15342.log.gz 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15289.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.15288.log.gz 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14643.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14516.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.15508.log.gz 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15504.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15341.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14643.log: /var/log/ceph/ceph-client.admin.15504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15343.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.14643.log.gz 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15341.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14531.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15343.log: 91.4%/var/log/ceph/ceph-osd.3.log: -- replaced with /var/log/ceph/ceph-client.admin.15289.log.gz 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14443.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.15504.log.gz 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14474.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.15341.log.gz 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.14838.log.gz 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15506.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14474.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.15343.log.gz 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14625.log 2026-02-13T08:14:34.520 INFO:teuthology.orchestra.run.trial119.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.14817.log.gz 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15426.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14625.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15426.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.15506.log.gz 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14659.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14148.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.14625.log.gz 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.14531.log.gz 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.15426.log.gz 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14719.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14258.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.14659.log.gz 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14754.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14621.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14372.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14754.log: /var/log/ceph/ceph-client.admin.14621.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.14443.log.gz 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14098.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14406.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.14474.log.gz 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14372.log: /var/log/ceph/ceph-client.admin.14098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14277.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.14621.log.gz 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15235.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.14148.log.gz 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14406.log: /var/log/ceph/ceph-client.admin.14277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.11219.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14640.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14617.log 2026-02-13T08:14:34.521 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.11219.log: /var/log/ceph/ceph-client.admin.14640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14304.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.11219.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14617.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.15235.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14194.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.14617.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14663.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14304.log: /var/log/ceph/ceph-client.admin.14194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.11243.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14663.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.14640.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.14663.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.11243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15340.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.14258.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph.audit.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.11243.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14644.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14797.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.11316.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14797.log: 92.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.14372.log.gz -5 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr: --verbose -- /var/log/ceph/ceph-client.admin.15233.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.14277.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.11316.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.14406.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.14304.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15233.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.11316.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14789.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr: 91.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.15340.log.gz 2026-02-13T08:14:34.522 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15290.log 2026-02-13T08:14:34.523 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15344.log 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.14644.log.gz 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.15233.log.gz 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15507.log 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14661.log 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr: 88.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15507.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.14789.log.gz 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14106.log 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14114.log 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.15290.log.gz 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14669.log 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14122.log 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14217.log 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.15507.log.gz 2026-02-13T08:14:34.525 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14122.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.15344.log.gz 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14766.log 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.14661.log.gz 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14350.log 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.11292.log 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14241.log 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14690.log 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.11292.log: /var/log/ceph/ceph-client.admin.14241.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.14797.log.gz 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14886.log 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.11292.log.gz 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.14122.log.gz 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14690.log: gzip -5 --verbose -- 92.3% /var/log/ceph/ceph-client.admin.15427.log -- replaced with /var/log/ceph/ceph-client.admin.14106.log.gz 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14499.log 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14130.log 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.14690.log.gz/var/log/ceph/ceph-client.admin.14499.log: 2026-02-13T08:14:34.526 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15234.log 2026-02-13T08:14:34.527 INFO:teuthology.orchestra.run.trial119.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.14754.log.gz 2026-02-13T08:14:34.527 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14336.log 2026-02-13T08:14:34.527 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14130.log: /var/log/ceph/ceph-client.admin.15234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14559.log 2026-02-13T08:14:34.527 INFO:teuthology.orchestra.run.trial119.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.14669.log.gz 2026-02-13T08:14:34.527 INFO:teuthology.orchestra.run.trial119.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.14499.log.gz 2026-02-13T08:14:34.527 INFO:teuthology.orchestra.run.trial119.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.14350.log.gz 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.11268.log 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.15427.log.gz 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15425.log 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.14241.log.gz 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.14559.log.gz 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.11268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14167.log 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.15234.log.gz 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.14766.log.gz 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.11268.log.gz 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15425.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.14336.log.gz 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.11195.log 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.15505.log 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.11195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.14090.log 2026-02-13T08:14:34.528 INFO:teuthology.orchestra.run.trial119.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.14516.log.gz 2026-02-13T08:14:34.529 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.15505.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.11195.log.gz 2026-02-13T08:14:34.529 INFO:teuthology.orchestra.run.trial119.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.14719.log.gz 2026-02-13T08:14:34.529 INFO:teuthology.orchestra.run.trial119.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.15505.log.gz 2026-02-13T08:14:34.529 INFO:teuthology.orchestra.run.trial119.stderr:/var/log/ceph/ceph-client.admin.14090.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.15425.log.gz 2026-02-13T08:14:34.529 INFO:teuthology.orchestra.run.trial119.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.14114.log.gz 2026-02-13T08:14:34.529 INFO:teuthology.orchestra.run.trial119.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.14167.log.gz 2026-02-13T08:14:34.540 INFO:teuthology.orchestra.run.trial119.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.14090.log.gz 2026-02-13T08:14:34.548 INFO:teuthology.orchestra.run.trial119.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.14886.log.gz 2026-02-13T08:14:34.550 INFO:teuthology.orchestra.run.trial119.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.14098.log.gz 2026-02-13T08:14:34.550 INFO:teuthology.orchestra.run.trial119.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.14130.log.gz 2026-02-13T08:14:34.555 INFO:teuthology.orchestra.run.trial119.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.14217.log.gz 2026-02-13T08:14:34.609 INFO:teuthology.orchestra.run.trial119.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-13T08:14:34.725 INFO:teuthology.orchestra.run.trial119.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-13T08:14:34.877 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2026-02-13T08:14:34.967 INFO:teuthology.orchestra.run.trial119.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.14194.log.gz 2026-02-13T08:14:35.148 INFO:teuthology.orchestra.run.trial104.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-13T08:14:35.165 INFO:teuthology.orchestra.run.trial104.stderr: 93.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-13T08:14:36.981 INFO:teuthology.orchestra.run.trial119.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-13T08:14:37.005 INFO:teuthology.orchestra.run.trial119.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-13T08:14:37.056 INFO:teuthology.orchestra.run.trial119.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-13T08:14:37.057 INFO:teuthology.orchestra.run.trial119.stderr: 2026-02-13T08:14:37.057 INFO:teuthology.orchestra.run.trial119.stderr:real 0m2.560s 2026-02-13T08:14:37.057 INFO:teuthology.orchestra.run.trial119.stderr:user 0m8.272s 2026-02-13T08:14:37.057 INFO:teuthology.orchestra.run.trial119.stderr:sys 0m0.379s 2026-02-13T08:14:37.065 INFO:teuthology.orchestra.run.trial104.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-13T08:14:37.077 INFO:teuthology.orchestra.run.trial104.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-13T08:14:37.299 INFO:teuthology.orchestra.run.trial104.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-13T08:14:37.300 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-13T08:14:37.300 INFO:teuthology.orchestra.run.trial104.stderr:real 0m2.843s 2026-02-13T08:14:37.301 INFO:teuthology.orchestra.run.trial104.stderr:user 0m9.022s 2026-02-13T08:14:37.301 INFO:teuthology.orchestra.run.trial104.stderr:sys 0m0.433s 2026-02-13T08:14:37.302 INFO:tasks.ceph:Archiving logs... 2026-02-13T08:14:37.302 DEBUG:teuthology.misc:Transferring archived files from trial104:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874/remote/trial104/log 2026-02-13T08:14:37.304 DEBUG:teuthology.orchestra.run.trial104:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T08:14:38.297 DEBUG:teuthology.misc:Transferring archived files from trial119:/var/log/ceph to /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874/remote/trial119/log 2026-02-13T08:14:38.297 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T08:14:39.091 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T08:14:39.103 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T08:14:39.103 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T08:14:39.105 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T08:14:39.225 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T08:14:39.237 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T08:14:39.237 DEBUG:teuthology.orchestra.run.trial104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T08:14:39.238 DEBUG:teuthology.orchestra.run.trial119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T08:14:39.308 INFO:teuthology.orchestra.run.trial119.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T08:14:39.308 INFO:teuthology.orchestra.run.trial119.stdout:============================================================================== 2026-02-13T08:14:39.308 INFO:teuthology.orchestra.run.trial119.stdout:+73.185.182.209 204.117.185.216 2 u 1 64 177 43.251 +2.309 7.717 2026-02-13T08:14:39.308 INFO:teuthology.orchestra.run.trial119.stdout:+139-177-202-26. 82.43.52.28 2 u 5 64 177 19.799 +16.449 6.688 2026-02-13T08:14:39.308 INFO:teuthology.orchestra.run.trial119.stdout:*clover0.mattnor 192.126.175.149 3 u 63 64 77 40.464 +2.100 4.507 2026-02-13T08:14:39.308 INFO:teuthology.orchestra.run.trial119.stdout:-149.248.12.167 132.239.1.6 2 u - 64 77 63.162 +3.397 6.899 2026-02-13T08:14:39.309 INFO:teuthology.orchestra.run.trial104.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T08:14:39.309 INFO:teuthology.orchestra.run.trial104.stdout:============================================================================== 2026-02-13T08:14:39.309 INFO:teuthology.orchestra.run.trial104.stdout:*73.185.182.209 204.117.185.216 2 u 65 64 377 41.527 +1.086 4.123 2026-02-13T08:14:39.309 INFO:teuthology.orchestra.run.trial104.stdout:-139-177-202-26. 82.43.52.28 2 u 3 64 377 19.731 +11.663 2.144 2026-02-13T08:14:39.309 INFO:teuthology.orchestra.run.trial104.stdout:+clover0.mattnor 192.126.175.149 3 u 1 64 377 40.676 -0.732 2.732 2026-02-13T08:14:39.309 INFO:teuthology.orchestra.run.trial104.stdout:+149.248.12.167 132.239.1.6 2 u 59 64 377 63.044 +3.016 6.259 2026-02-13T08:14:39.309 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T08:14:39.320 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T08:14:39.320 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T08:14:39.334 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T08:14:39.349 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T08:14:39.363 INFO:teuthology.task.internal:Duration was 660.455227 seconds 2026-02-13T08:14:39.363 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T08:14:39.377 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T08:14:39.378 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T08:14:39.380 DEBUG:teuthology.orchestra.run.trial119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T08:14:39.405 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T08:14:39.405 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial104.front.sepia.ceph.com 2026-02-13T08:14:39.406 DEBUG:teuthology.orchestra.run.trial104:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T08:14:39.453 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial119.front.sepia.ceph.com 2026-02-13T08:14:39.454 DEBUG:teuthology.orchestra.run.trial119:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T08:14:39.460 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T08:14:39.461 DEBUG:teuthology.orchestra.run.trial104:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T08:14:39.500 DEBUG:teuthology.orchestra.run.trial119:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T08:14:39.640 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T08:14:39.640 DEBUG:teuthology.orchestra.run.trial104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T08:14:39.642 DEBUG:teuthology.orchestra.run.trial119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T08:14:39.649 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T08:14:39.650 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T08:14:39.650 INFO:teuthology.orchestra.run.trial104.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T08:14:39.650 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T08:14:39.651 INFO:teuthology.orchestra.run.trial104.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T08:14:39.652 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T08:14:39.652 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T08:14:39.653 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T08:14:39.653 INFO:teuthology.orchestra.run.trial119.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T08:14:39.653 INFO:teuthology.orchestra.run.trial119.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T08:14:39.690 INFO:teuthology.orchestra.run.trial104.stderr: 82.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T08:14:39.692 INFO:teuthology.orchestra.run.trial119.stderr: 82.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T08:14:39.694 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T08:14:39.711 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T08:14:39.711 DEBUG:teuthology.orchestra.run.trial104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T08:14:39.743 DEBUG:teuthology.orchestra.run.trial119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T08:14:39.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T08:14:39.770 DEBUG:teuthology.orchestra.run.trial104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T08:14:39.789 DEBUG:teuthology.orchestra.run.trial119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T08:14:39.795 INFO:teuthology.orchestra.run.trial104.stdout:kernel.core_pattern = core 2026-02-13T08:14:39.803 INFO:teuthology.orchestra.run.trial119.stdout:kernel.core_pattern = core 2026-02-13T08:14:39.811 DEBUG:teuthology.orchestra.run.trial104:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T08:14:39.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T08:14:39.847 DEBUG:teuthology.orchestra.run.trial119:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T08:14:39.858 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T08:14:39.858 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T08:14:39.876 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T08:14:39.877 DEBUG:teuthology.misc:Transferring archived files from trial104:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874/remote/trial104 2026-02-13T08:14:39.877 DEBUG:teuthology.orchestra.run.trial104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T08:14:39.918 DEBUG:teuthology.misc:Transferring archived files from trial119:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47874/remote/trial119 2026-02-13T08:14:39.918 DEBUG:teuthology.orchestra.run.trial119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T08:14:39.974 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T08:14:39.974 DEBUG:teuthology.orchestra.run.trial104:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T08:14:39.977 DEBUG:teuthology.orchestra.run.trial119:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T08:14:39.984 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T08:14:40.003 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T08:14:40.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T08:14:40.020 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T08:14:40.021 DEBUG:teuthology.orchestra.run.trial104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T08:14:40.028 DEBUG:teuthology.orchestra.run.trial119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T08:14:40.031 INFO:teuthology.orchestra.run.trial104.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 08:14 /home/ubuntu/cephtest 2026-02-13T08:14:40.033 INFO:teuthology.orchestra.run.trial119.stdout: 1180220 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 08:14 /home/ubuntu/cephtest 2026-02-13T08:14:40.034 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T08:14:40.052 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T08:14:40.091 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/{bluestore/{alloc$/{avl} base mem$/{normal-2} onode-segment$/{512K} write$/{v2/{compr$/{yes$/{lz4}} v2}}}} rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_api_tests} duration: 660.4552271366119 flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com success: true 2026-02-13T08:14:40.091 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T08:14:40.201 INFO:teuthology.run:pass